-- Logs begin at Wed 2022-02-09 12:16:37 UTC, end at Wed 2022-02-09 13:31:12 UTC. -- Feb 09 13:02:26.804890 dv-cinder-827860-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 09 13:02:26.813520 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 09 13:02:26.815711 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Feb 9 13:02:26 2022] *** Feb 09 13:02:26.815711 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 09 13:02:26.815711 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 09 13:02:26.815711 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: nodename: dv-cinder-827860-3-iscsi Feb 09 13:02:26.815711 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: machine: x86_64 Feb 09 13:02:26.815711 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: clock source: unix Feb 09 13:02:26.815711 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: pcre jit disabled Feb 09 13:02:26.815711 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: detected number of CPU cores: 4 Feb 09 13:02:26.815711 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: current working directory: / Feb 09 13:02:26.815711 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: detected binary path: /usr/bin/uwsgi-core Feb 09 13:02:26.816357 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: your processes number limit is 47680 Feb 09 13:02:26.816357 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: your memory page size is 4096 bytes Feb 09 13:02:26.816357 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: detected max file descriptor number: 2048 Feb 09 13:02:26.816357 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: lock engine: pthread robust mutexes Feb 09 13:02:26.816357 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: thunder lock: enabled Feb 09 13:02:26.816357 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 09 13:02:26.816357 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 09 13:02:26.862147 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: Python main interpreter initialized at 0x562ee50429c0 Feb 09 13:02:26.862147 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: python threads support enabled Feb 09 13:02:26.862147 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: your server socket listen backlog is limited to 100 connections Feb 09 13:02:26.862147 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: your mercy for graceful operations on workers is 90 seconds Feb 09 13:02:26.862592 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: mapped 403077 bytes (393 KB) for 2 cores Feb 09 13:02:26.862592 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: *** Operational MODE: preforking *** Feb 09 13:02:26.862848 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: *** uWSGI is running in multiple interpreter mode *** Feb 09 13:02:26.862848 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: spawned uWSGI master process (pid: 102420) Feb 09 13:02:26.863042 dv-cinder-827860-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 09 13:02:26.864135 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: spawned uWSGI worker 1 (pid: 102421, cores: 1) Feb 09 13:02:26.864135 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: spawned uWSGI worker 2 (pid: 102422, cores: 1) Feb 09 13:02:26.864135 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 09 13:02:28.654639 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 09 13:02:28.654639 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: from cryptography.utils import int_from_bytes Feb 09 13:02:28.655249 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 09 13:02:28.655249 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: from cryptography.utils import int_from_bytes Feb 09 13:02:28.659572 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 09 13:02:28.659572 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: from cryptography.utils import int_from_bytes Feb 09 13:02:28.660072 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 09 13:02:28.660072 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: from cryptography.utils import int_from_bytes Feb 09 13:02:31.240533 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 09 13:02:31.241283 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 09 13:02:31.241387 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 09 13:02:31.241685 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 09 13:02:31.241945 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 09 13:02:31.242337 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.242717 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.243043 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.243364 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.243699 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.243811 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 09 13:02:31.244171 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 09 13:02:31.244260 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.244345 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.244478 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 09 13:02:31.244629 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.244841 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 09 13:02:31.244962 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.245099 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 09 13:02:31.245232 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.245483 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.245589 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.245809 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.245901 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-827860-3-iscsi {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.246129 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.246220 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.246447 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.246548 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.246795 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.246893 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.247122 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.247221 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.247435 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.247530 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.247761 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.247852 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.248073 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.248169 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.248342 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.248583 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.248692 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.248969 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-827860-3-iscsi {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.249076 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.249293 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.249396 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.249604 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.249695 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.249912 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.250116 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.250219 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.250299 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.250525 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.250665 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.250872 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.250979 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.251179 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.251271 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.251506 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.251681 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.251820 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.251993 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.252227 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-827860-3-iscsi {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.252321 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.252554 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.252646 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.252873 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.252969 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.253193 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.253285 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.253511 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.253619 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.253834 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.253939 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.254139 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.254231 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.254463 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.254587 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.254800 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.254927 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.255165 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.255306 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-827860-3-iscsi {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.255497 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.255592 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.255806 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.255898 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.256119 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.256255 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.256473 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.256603 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.256785 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.256910 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.257103 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.257231 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.257423 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.257546 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.257747 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.257874 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.258057 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.258168 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.258366 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.258595 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.258725 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.258831 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.258932 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.259077 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.259260 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.259404 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.259586 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.259713 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.259915 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.260046 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.260181 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.260307 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.260428 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.260560 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.260727 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.261117 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.261313 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.261448 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.261600 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.261734 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.261909 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.262061 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.262763 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.262848 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.262982 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.263113 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.263211 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.263337 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.263337 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.263493 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.263577 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.263672 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.263758 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.263852 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.263989 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.264101 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.264300 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.264456 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.264639 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.264741 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.264943 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.265037 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.265249 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.265345 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.265554 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.265707 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.84 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.265860 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.265954 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.84 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.266164 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.266263 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.266472 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.266616 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.266814 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.266944 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.267129 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.267259 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.267448 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.267588 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.267755 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.267914 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.268073 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.268227 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.268467 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.84 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.268560 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.268718 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.84 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.268836 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.269023 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.269158 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.269363 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.269504 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.269680 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.269816 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.270012 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.270106 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.270300 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.270393 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.270643 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.270749 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.270951 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.271047 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.271257 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.271343 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.271560 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.271659 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.272389 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.272488 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.272725 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.272811 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.273031 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.273130 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.273284 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.273379 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.273587 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.273680 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.273979 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.274117 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.274243 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.274344 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.274593 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.274688 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.274900 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.275008 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.275213 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.275312 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.275514 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.275637 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.276645 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.276889 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.277006 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.277091 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.277178 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.277268 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.277361 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.277446 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.277532 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.277611 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.277687 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.277762 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.277849 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.277939 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.278027 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.278179 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.278270 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.278355 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.278478 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.278601 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.278823 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.278910 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.279132 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.279218 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.279443 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.279529 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.279749 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.279840 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.281177 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.281287 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.281375 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.281453 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.281539 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.281617 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.281692 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.281767 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.281850 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.281935 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.282019 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.282103 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.282181 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.282257 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.282349 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.282434 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.282597 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.282692 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.282779 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.282866 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.283081 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.283173 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.283384 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.283470 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.283691 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.283787 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.283996 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.284089 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.284302 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.284452 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.284611 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.284708 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.284912 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.284999 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.285216 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.285313 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.285521 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.285689 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.285827 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.285911 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.286129 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.286215 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.286434 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.286529 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.286758 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.286845 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.287077 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.287163 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.287398 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.290817 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.290927 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.291020 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.291109 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.291188 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.291275 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.291354 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.291429 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:02:31.291511 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.291595 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.291674 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.291763 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.291849 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.291849 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.291995 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.292079 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.292165 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.292252 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.292330 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.292413 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.292496 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.292580 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.292666 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.292752 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.292834 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.292918 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.292995 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.293071 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.293158 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.293236 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.293318 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.293318 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.293615 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.293708 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.293856 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.293942 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.294020 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.294020 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.294143 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.294263 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.294412 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.294592 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.294682 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.294911 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.295000 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.295231 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.295386 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.295543 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.295638 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.295860 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.295958 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.296170 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.296263 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.296484 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.296570 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.296793 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.296886 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.297131 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.297218 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.297454 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.297541 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.297766 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.297852 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.298080 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.298175 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.298395 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.298480 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.298732 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.298819 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.299044 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.299131 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.299356 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.299440 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.299674 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.299768 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.300004 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.300090 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.300312 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.300404 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.300627 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.300721 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.300935 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.301027 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.301245 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.301331 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.301552 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.301650 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.301861 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.301946 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.302166 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.302258 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.302473 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.302661 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.302804 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.302890 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.303140 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.303227 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.303451 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.303545 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.303766 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.303854 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.304077 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.304164 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.304387 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.304481 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.304694 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.304779 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.304998 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.305082 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.305303 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.305390 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.305606 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.305692 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.305915 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.305998 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.306216 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.306302 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.306529 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.306679 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.306863 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.306949 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.307171 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.307258 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.307497 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.307583 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.307858 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.307952 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.308178 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.308271 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.308488 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.308577 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.308796 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.308968 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.309100 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.309194 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.309411 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.309503 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.309717 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.309818 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.310020 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.310105 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.310331 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.310423 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.310659 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.310761 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.310964 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.311049 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.311283 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.311368 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.311585 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.311673 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.311887 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.311973 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.312196 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.312281 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.312504 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.312592 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.312812 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.312904 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.313119 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.313204 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.313437 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.313532 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.313745 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.313831 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.314054 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.314260 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.314347 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.314626 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.314715 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.314963 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.315064 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.315271 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.315358 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.315576 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.315662 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.315880 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.315965 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.316184 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.316271 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.316488 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.316573 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.316796 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.316881 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.317096 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.317191 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.317400 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.317485 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.317699 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.317792 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.318004 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.318105 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.318302 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.318437 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.318628 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.319274 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.319443 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.319532 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.319751 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.319839 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.320053 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.320155 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.320372 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.320459 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.320679 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.320766 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.320980 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.321076 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.321284 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.321377 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.321586 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.321672 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.321924 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.322021 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.322228 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.322320 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.322578 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.322666 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.322898 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.322986 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.323221 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.323307 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.323536 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.323621 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.323846 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.323932 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.324160 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.324252 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.324468 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.324561 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.324775 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.324864 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.325083 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.325170 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.325394 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.325515 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.325741 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.325836 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.326050 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.326180 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.326367 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.326462 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.326705 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.326805 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.327023 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.327109 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.327338 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.327434 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.327654 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.327739 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.327964 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.328048 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.328275 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.328379 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.328598 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.328687 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.328911 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.329004 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.329226 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.329323 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.329539 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.329631 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.329852 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.329945 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.330161 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.330255 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.330467 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.330598 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.330798 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.330883 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.331104 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.331191 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.331411 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.331506 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.331731 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.331817 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.332041 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.332135 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.332353 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.332445 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.332658 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.332743 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.332976 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.333062 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.333278 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.333362 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.333592 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.333684 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.333893 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.333980 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.334200 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.334284 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.335074 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.335193 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.335399 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.335485 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.335704 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.335799 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.336013 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.336109 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.336323 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.336409 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.336631 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.336715 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.336939 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.337039 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.337246 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.337338 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.337548 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.337632 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.337852 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.337956 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.338159 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.338246 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.338472 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.338612 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.338818 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.338908 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.339126 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.339212 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.339429 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.339516 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.339735 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.339828 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.340038 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.340129 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.340357 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.340442 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.340668 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.340762 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.340975 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.341070 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.341282 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.341377 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.341611 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.341698 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.341928 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.342027 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.342245 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.342340 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.342546 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.342673 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.342871 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.342968 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.343190 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.343287 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.343497 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.343582 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.343799 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.343885 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.344102 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.344199 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.344405 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.344498 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.344724 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.344808 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.345038 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.345134 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.345339 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.345425 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.345653 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.345783 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.345966 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.346053 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.346272 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.346406 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.346601 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.346691 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.346913 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.347008 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.347222 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.347316 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.347532 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.347624 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.347840 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.347933 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.348147 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.348242 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.348456 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.348543 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.348764 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.349036 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.349122 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.349367 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.349460 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.349683 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.349769 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.350011 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.350096 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.350321 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.350409 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.350651 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.350752 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.350955 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.351041 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.351263 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.351349 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.351578 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.351665 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.351950 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.352140 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.352266 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.352471 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.352567 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.352782 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.352877 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.353097 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.353183 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.353412 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.353498 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.353727 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.353821 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.354046 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.354168 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.354360 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.354446 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.354691 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.354781 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.355000 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.355084 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.355305 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.355408 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.355606 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.355706 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.355910 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.355999 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.356215 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.356309 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.356529 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.356625 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.356835 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.356930 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.357158 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.357248 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.357462 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.357549 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.357766 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.357852 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.358067 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.358153 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.358368 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.358454 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.358692 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.358844 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.359006 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.359093 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.359307 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.359395 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.359618 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.359711 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.359918 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.360012 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.360234 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.360327 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.360538 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.360624 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.360838 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.360936 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.361138 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.361224 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.361438 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.361525 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.361773 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.361865 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.362072 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.362163 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.362380 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.362483 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.362708 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.362810 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.363024 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.363109 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.363338 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.363422 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.363652 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.363746 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.363965 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.364051 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.364266 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.364349 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.364569 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.364656 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.364869 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.364954 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.365178 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.365270 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.365485 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.365572 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.365809 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.365931 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.366113 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.366197 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.366419 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.366518 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.366752 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.366851 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.367057 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.367156 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.367355 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.367448 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.367661 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.367748 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.367961 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.368060 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.368272 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.368368 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.368576 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.368661 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.368876 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.368970 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.369176 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.369270 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.369483 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.369567 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.369790 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.369884 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.370088 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.370179 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.370393 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.370480 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.370720 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.370809 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.371026 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.371110 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.371326 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.371410 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.371635 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.371721 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.371943 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.372029 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.372256 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.372341 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.372581 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.372668 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.372881 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.372965 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.373193 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.373277 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.373499 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.373586 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.373803 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.373889 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.374103 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.374198 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.374407 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.374491 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.374729 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.374815 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.375033 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.375129 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.375338 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.375422 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.375645 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.375729 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.375951 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.376099 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.376250 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.376336 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.376557 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.376686 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.376858 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.376953 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.377161 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.377247 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.377461 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.377546 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.377766 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.377851 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.378062 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.378147 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.378364 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.378457 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.378687 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.378778 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.378989 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.379074 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.379290 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.379375 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.379613 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.379701 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.379920 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.380006 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.380222 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.380306 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.380523 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.380610 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.380823 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.380917 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.381661 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.381763 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.381980 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.382065 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.382318 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.382402 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.382651 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.382755 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.382962 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.383046 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.383274 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.383357 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.383585 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.383679 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.383895 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.383988 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.384206 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.384292 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.384510 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.384604 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.384821 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.384907 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.385128 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.385215 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.385438 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.385532 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.385736 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.386079 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.386292 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.386379 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.386630 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.386766 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.386941 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.387024 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.387254 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.387348 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.387641 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.387735 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.387954 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.388047 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.388270 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.388359 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.388571 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.388666 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.388881 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.388971 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.389192 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.389279 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.389501 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.389589 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.389806 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.389890 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.390114 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.390212 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.390421 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.390509 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.390758 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.390862 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.391066 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.391161 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.391373 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.391471 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.391681 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.391767 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.391982 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.392082 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.392288 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.392441 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.392593 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.392760 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.392895 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.393078 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.393215 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.393388 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.393520 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.393705 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.393804 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.394022 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.394108 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.394342 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.394429 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.394682 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.394852 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.394994 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.395080 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.395414 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.395508 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.395723 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.395818 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.396033 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.396119 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.396337 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.396434 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.396644 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.396739 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.397511 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.397615 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.397830 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.397916 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.398161 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.398239 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.398478 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.398569 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.398827 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.398936 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.399137 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.399276 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.399465 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.399560 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.399776 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.399863 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.400102 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.400190 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.400426 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.400513 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.400736 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.400829 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.401058 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.401146 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.401361 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.401520 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.401666 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.401836 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.401968 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.402152 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.402290 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.402479 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.402622 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.402831 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.402922 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.403160 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.403322 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.403469 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.403632 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.403786 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.403935 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.404100 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.404347 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.404433 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.404657 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.404753 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.404967 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.405053 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.405289 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.405375 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.405610 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.405707 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.405931 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.406035 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.406237 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.406363 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.406551 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.406665 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.406885 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.406984 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.407206 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.407324 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.407528 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.407652 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.407839 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.407968 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.408152 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.408293 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.408455 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.408625 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.408775 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.408937 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.409094 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.409247 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.409406 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.409560 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.409726 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.409871 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.410143 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.410238 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.410464 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.410592 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.410799 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.410888 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.411118 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.411204 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.411431 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.411525 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.411734 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.411826 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.412034 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.412121 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.412340 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.412453 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.412692 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.412792 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.412997 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.413090 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.413320 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.413478 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.413624 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.413711 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.413935 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.414023 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.414251 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.414345 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.414547 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.414655 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.414873 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.414964 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.415179 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.415275 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.415494 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.415580 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.415795 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.415880 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.416099 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.416186 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.416413 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.416498 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.416731 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.416827 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.417052 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.417143 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.417356 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.417449 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.417676 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.417771 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.417983 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.418082 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.418285 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.418372 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.418667 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.418777 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.418979 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.419098 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.419295 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.419420 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.419611 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.419707 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.419917 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.420010 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.420224 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.420312 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.420536 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.420632 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.420849 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.420970 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.421174 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.421256 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.421501 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.421591 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.421811 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.421899 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.422118 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.422204 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.422423 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.422511 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.422754 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.422844 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.423057 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.423150 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.423366 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.423462 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.423670 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.423756 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.423975 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.424074 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.424278 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.424378 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.424582 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.424667 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.424882 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.424976 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.425184 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.425271 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.425484 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.425570 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.425805 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.425902 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.426110 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.426205 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.426431 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.426677 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.426929 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.427041 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.427124 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.427203 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.427348 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.427437 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.427650 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.427747 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.427992 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.428106 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.428321 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.428409 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.428651 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.428740 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.428967 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.429060 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.429286 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.429372 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.429603 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.429691 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.429910 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.429997 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.430226 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.430312 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.430540 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.430661 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.430878 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.430966 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.431192 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.431404 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.431500 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.431737 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.431834 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.432122 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.432251 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.432368 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.432464 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.432658 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.432752 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.432978 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.433064 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.433297 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.433385 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.433607 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.433694 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.433920 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.434190 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.434291 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.434533 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.434701 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.434885 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.435014 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.435203 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.435291 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.435517 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.435605 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.435833 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.435929 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.436146 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.436235 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.436459 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.436546 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.436771 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.436868 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.437082 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.437178 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.437392 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.437481 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.437720 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.437816 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.438040 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.438126 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.438362 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.438447 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.438707 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.438810 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.439023 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.439108 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.439337 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.439424 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.439650 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.439737 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.439961 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.440054 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.440274 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.440359 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.440590 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.440679 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.440903 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.440991 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.441219 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.441305 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.441531 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.441663 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.441843 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.441935 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.442155 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.442318 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.442464 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.442571 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.442804 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.442918 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.443162 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.443287 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.443424 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.443516 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.444258 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.444471 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.444571 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.444794 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.444883 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.445133 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.445219 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.445463 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.445563 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.445791 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.445887 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.446104 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.446198 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.446416 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.446517 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.446755 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.446861 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.447065 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.447264 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.447374 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.447576 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.447674 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.447905 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.447993 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.448227 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.448321 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.448548 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.448637 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.448862 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.448957 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.449177 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.449272 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.449496 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.449583 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.449809 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.449903 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.450182 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.450335 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.450491 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.450711 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.450826 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.451037 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.451124 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.451369 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.451483 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.451700 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.451789 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.452020 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.452107 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.452331 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.452419 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.452634 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.452721 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.452959 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.453158 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.453268 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.453503 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.453597 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.453816 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.453906 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.454140 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.454229 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.454462 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.454549 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.454801 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.454898 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.455105 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.455241 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.455412 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.455497 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.455716 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.455809 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.456018 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.456106 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.456332 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.456421 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.456640 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.456739 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.456942 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.457040 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.457246 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.457334 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.457554 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.457649 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.457860 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.457946 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.458159 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.458251 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.458466 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.458589 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.458798 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.458886 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.459122 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.459209 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.459482 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.460079 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.460295 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.460389 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.460598 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.460693 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.460909 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.460996 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.461211 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.461304 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.461514 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.461601 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.461817 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.461904 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.462118 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.462212 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.462427 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.462514 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.462753 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.462852 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.463059 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.463146 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.463362 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.463448 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.463671 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.463760 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.463973 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.464068 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.464281 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.464381 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.464581 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.464668 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.464948 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.465035 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.465249 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.465481 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.465632 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.465816 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.465950 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.466142 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.466259 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.466477 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.466603 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.466838 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.466967 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.467148 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.467235 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.467458 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.467546 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.467765 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.467861 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.468093 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.468349 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.468439 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.468680 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.468767 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.468998 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.469093 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.469313 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.469408 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.469626 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.469724 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.469930 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.470023 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.470241 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.470329 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.470544 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.470657 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.470878 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.470977 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.471187 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.471279 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.471494 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.471587 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.471803 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.471902 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.472112 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.472206 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.472420 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.472508 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.472729 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.472894 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.473038 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.473134 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.473344 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.473438 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.473650 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.473738 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.473956 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.474043 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.474261 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.474348 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.474584 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.474674 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.474929 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.475027 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.475248 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.475334 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.475561 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.475659 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.475867 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.475952 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.476178 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.476286 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.476487 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.476602 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.476794 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.476926 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.477102 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.477250 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.477407 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.477563 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.477721 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.477886 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.478045 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.478210 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.478359 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.478531 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.478688 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.478875 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.479102 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.479202 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.479413 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.479500 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.479730 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.479817 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.480049 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.480145 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.480363 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.480450 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.480682 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.480778 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.481043 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.481131 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.481351 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.481438 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.481665 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.481751 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.481977 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.482065 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.482302 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.482389 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.482647 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.482749 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.482972 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.483059 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.483286 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.483383 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.483590 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.483684 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.483896 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.483991 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.484200 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.484294 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.484506 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.484607 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.484827 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.484913 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.485139 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.485225 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.485455 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.485546 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.485774 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.485866 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.486083 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.486168 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.486397 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.486484 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.486727 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.486815 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.487037 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.487161 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.487349 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.487438 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.487658 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.487745 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.487967 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.488054 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.488287 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.488375 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.488595 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.488689 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.488906 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.489002 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.489217 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.489305 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.489526 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.489613 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.489836 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.489932 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.490149 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.490243 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.490463 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.490627 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.490827 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.490926 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.491129 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.491214 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.491440 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.491533 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.491753 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.491847 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.492070 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.492158 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.492384 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.492473 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.492691 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.492780 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.493016 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.493111 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.493326 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.493422 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.493639 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.493728 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.493947 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.494043 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.494254 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.494350 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.494606 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.494698 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.494900 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.494999 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.495223 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.495325 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.495543 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.495636 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.495788 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 09 13:02:31.495875 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.496175 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.496518 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.496910 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.497251 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.497576 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.497889 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.498201 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.498504 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:02:31.498780 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 09 13:02:31.519241 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG oslo_db.sqlalchemy.engines [None req-9abdaddc-94e0-4587-b57b-9221a9beb213 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 09 13:02:31.521255 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_db.sqlalchemy.engines [None req-7f2d52cc-0ddd-4316-bc62-ce8b847d29eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102421) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 09 13:02:31.582946 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.context [None req-9abdaddc-94e0-4587-b57b-9221a9beb213 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e47d22a-5d94-47f3-baff-22c6e92e901b(cell1) {{(pid=102422) load_cells /opt/stack/nova/nova/context.py:464}} Feb 09 13:02:31.585552 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.context [None req-7f2d52cc-0ddd-4316-bc62-ce8b847d29eb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e47d22a-5d94-47f3-baff-22c6e92e901b(cell1) {{(pid=102421) load_cells /opt/stack/nova/nova/context.py:464}} Feb 09 13:02:31.587296 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG oslo_concurrency.lockutils [None req-9abdaddc-94e0-4587-b57b-9221a9beb213 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:02:31.588889 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG oslo_concurrency.lockutils [None req-9abdaddc-94e0-4587-b57b-9221a9beb213 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:02:31.589707 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG oslo_concurrency.lockutils [None req-9abdaddc-94e0-4587-b57b-9221a9beb213 None None] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:02:31.591695 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG oslo_concurrency.lockutils [None req-9abdaddc-94e0-4587-b57b-9221a9beb213 None None] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:02:31.592229 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_concurrency.lockutils [None req-7f2d52cc-0ddd-4316-bc62-ce8b847d29eb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:02:31.593923 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_concurrency.lockutils [None req-7f2d52cc-0ddd-4316-bc62-ce8b847d29eb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:02:31.594785 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_concurrency.lockutils [None req-7f2d52cc-0ddd-4316-bc62-ce8b847d29eb None None] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:02:31.596830 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_concurrency.lockutils [None req-7f2d52cc-0ddd-4316-bc62-ce8b847d29eb None None] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:02:31.604985 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG oslo_db.sqlalchemy.engines [None req-9abdaddc-94e0-4587-b57b-9221a9beb213 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 09 13:02:31.605979 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG oslo_db.sqlalchemy.engines [None req-9abdaddc-94e0-4587-b57b-9221a9beb213 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 09 13:02:31.611782 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_db.sqlalchemy.engines [None req-7f2d52cc-0ddd-4316-bc62-ce8b847d29eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102421) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 09 13:02:31.614578 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_db.sqlalchemy.engines [None req-7f2d52cc-0ddd-4316-bc62-ce8b847d29eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102421) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 09 13:02:31.768472 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG oslo_db.sqlalchemy.engines [None req-9abdaddc-94e0-4587-b57b-9221a9beb213 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 09 13:02:31.771188 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_db.sqlalchemy.engines [None req-7f2d52cc-0ddd-4316-bc62-ce8b847d29eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102421) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 09 13:02:32.177775 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: WARNING keystonemiddleware.auth_token [None req-9abdaddc-94e0-4587-b57b-9221a9beb213 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 09 13:02:32.184326 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: WARNING keystonemiddleware.auth_token [None req-9abdaddc-94e0-4587-b57b-9221a9beb213 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 09 13:02:32.190681 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: WARNING keystonemiddleware.auth_token [None req-7f2d52cc-0ddd-4316-bc62-ce8b847d29eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 09 13:02:32.197826 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: WARNING keystonemiddleware.auth_token [None req-7f2d52cc-0ddd-4316-bc62-ce8b847d29eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 09 13:02:32.522399 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: WARNING keystonemiddleware.auth_token [None req-9abdaddc-94e0-4587-b57b-9221a9beb213 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 09 13:02:32.527688 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: WARNING keystonemiddleware.auth_token [None req-9abdaddc-94e0-4587-b57b-9221a9beb213 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 09 13:02:32.532748 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562ee50429c0 pid: 102422 (default app) Feb 09 13:02:32.534820 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-9abdaddc-94e0-4587-b57b-9221a9beb213 None None] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:02:32.535979 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-9abdaddc-94e0-4587-b57b-9221a9beb213 None None] 10.222.0.84 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001735 Feb 09 13:02:32.536380 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 1/1] 10.222.0.84 () {50 vars in 788 bytes} [Wed Feb 9 13:02:32 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:02:32.546315 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: WARNING keystonemiddleware.auth_token [None req-7f2d52cc-0ddd-4316-bc62-ce8b847d29eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 09 13:02:32.551704 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: WARNING keystonemiddleware.auth_token [None req-7f2d52cc-0ddd-4316-bc62-ce8b847d29eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 09 13:02:32.557328 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562ee50429c0 pid: 102421 (default app) Feb 09 13:03:57.877049 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-9abdaddc-94e0-4587-b57b-9221a9beb213 None None] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:03:57.878041 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-9abdaddc-94e0-4587-b57b-9221a9beb213 None None] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Feb 09 13:03:57.878523 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 2/2] 10.222.0.84 () {54 vars in 930 bytes} [Wed Feb 9 13:03:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:03:58.329380 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-293e7e15-963a-4150-a08f-ebe5a106f762 admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:03:58.366048 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-293e7e15-963a-4150-a08f-ebe5a106f762 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.479879 Feb 09 13:03:58.366986 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 1/3] 10.222.0.84 () {60 vars in 1291 bytes} [Wed Feb 9 13:03:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:04:00.684694 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-9abdaddc-94e0-4587-b57b-9221a9beb213 None None] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:00.684694 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-9abdaddc-94e0-4587-b57b-9221a9beb213 None None] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Feb 09 13:04:00.684694 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 3/4] 10.222.0.84 () {54 vars in 930 bytes} [Wed Feb 9 13:04:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:04:00.746214 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-d767dd18-7b44-47b5-914c-57d630bd011d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 256, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "id": "c1"}} {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:04:00.764943 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:04:00.764943 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: warnings.warn(msg) Feb 09 13:04:00.856261 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-d767dd18-7b44-47b5-914c-57d630bd011d admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.165833 Feb 09 13:04:00.856903 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 2/5] 10.222.0.84 () {64 vars in 1282 bytes} [Wed Feb 9 13:04:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 09 13:04:01.086599 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-dcfa263c-70ef-402b-a924-85c2c0e875f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:04:01.088990 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:04:01.088990 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: warnings.warn(msg) Feb 09 13:04:01.197299 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-dcfa263c-70ef-402b-a924-85c2c0e875f7 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.332141 Feb 09 13:04:01.197934 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 4/6] 10.222.0.84 () {64 vars in 1335 bytes} [Wed Feb 9 13:04:00 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:04:03.515013 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-d767dd18-7b44-47b5-914c-57d630bd011d admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:03.515954 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-d767dd18-7b44-47b5-914c-57d630bd011d admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Feb 09 13:04:03.516369 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 3/7] 10.222.0.84 () {54 vars in 930 bytes} [Wed Feb 9 13:04:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:04:03.628636 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-91b2f112-4d13-4bbf-8656-2178da07cc27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "vcpus": 1, "id": "d1", "os-flavor-access:is_public": true}} {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:04:03.647342 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:04:03.647342 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: warnings.warn(msg) Feb 09 13:04:03.752770 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-91b2f112-4d13-4bbf-8656-2178da07cc27 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.229727 Feb 09 13:04:03.753332 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 5/8] 10.222.0.84 () {64 vars in 1282 bytes} [Wed Feb 9 13:04:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 09 13:04:03.765979 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-b21da646-9c63-4323-9038-daa930eabf77 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:04:03.767768 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:04:03.767768 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: warnings.warn(msg) Feb 09 13:04:03.928303 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-b21da646-9c63-4323-9038-daa930eabf77 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.165343 Feb 09 13:04:03.929073 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 4/9] 10.222.0.84 () {64 vars in 1335 bytes} [Wed Feb 9 13:04:03 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:04:06.260971 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-91b2f112-4d13-4bbf-8656-2178da07cc27 admin admin] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:06.262170 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-91b2f112-4d13-4bbf-8656-2178da07cc27 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001648 Feb 09 13:04:06.265891 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 6/10] 10.222.0.84 () {54 vars in 930 bytes} [Wed Feb 9 13:04:06 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:04:06.331825 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-461e540b-5108-42eb-9e5f-3e8619525cc7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "ram": 1024, "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:04:06.442293 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-461e540b-5108-42eb-9e5f-3e8619525cc7 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.172820 Feb 09 13:04:06.443676 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 5/11] 10.222.0.84 () {64 vars in 1282 bytes} [Wed Feb 9 13:04:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 09 13:04:06.457073 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-0b73d568-35d8-40a3-81cc-90691c1304ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:04:06.576427 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-0b73d568-35d8-40a3-81cc-90691c1304ea admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.121095 Feb 09 13:04:06.597720 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 7/12] 10.222.0.84 () {64 vars in 1335 bytes} [Wed Feb 9 13:04:06 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:04:08.917834 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-461e540b-5108-42eb-9e5f-3e8619525cc7 admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:08.918908 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-461e540b-5108-42eb-9e5f-3e8619525cc7 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Feb 09 13:04:08.919315 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 6/13] 10.222.0.84 () {54 vars in 930 bytes} [Wed Feb 9 13:04:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:04:08.978763 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-ac6ce003-ef04-4aa2-802d-6badb4e98e48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G", "vcpus": 2, "disk": 10, "swap": 0}} {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:04:09.062677 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-ac6ce003-ef04-4aa2-802d-6badb4e98e48 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137097 Feb 09 13:04:09.063351 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 8/14] 10.222.0.84 () {64 vars in 1282 bytes} [Wed Feb 9 13:04:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 09 13:04:09.074894 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-dbba7d1e-1ec3-4ede-be48-e7e24e0ee3df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:04:09.173977 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-dbba7d1e-1ec3-4ede-be48-e7e24e0ee3df admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102659 Feb 09 13:04:09.174492 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 7/15] 10.222.0.84 () {64 vars in 1335 bytes} [Wed Feb 9 13:04:09 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:04:11.480135 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-ac6ce003-ef04-4aa2-802d-6badb4e98e48 admin admin] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:11.481145 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-ac6ce003-ef04-4aa2-802d-6badb4e98e48 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Feb 09 13:04:11.481555 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 9/16] 10.222.0.84 () {54 vars in 930 bytes} [Wed Feb 9 13:04:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:04:11.540445 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-4ae80c3a-e8d6-4fb4-824c-e4fa9299756e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:04:11.628221 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-4ae80c3a-e8d6-4fb4-824c-e4fa9299756e admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140404 Feb 09 13:04:11.628895 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 8/17] 10.222.0.84 () {64 vars in 1282 bytes} [Wed Feb 9 13:04:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 09 13:04:11.640747 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-a182974d-0fe2-4252-93b4-916452cd0fac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:04:11.741036 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-a182974d-0fe2-4252-93b4-916452cd0fac admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104079 Feb 09 13:04:11.742066 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 10/18] 10.222.0.84 () {64 vars in 1335 bytes} [Wed Feb 9 13:04:11 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:04:14.030757 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-4ae80c3a-e8d6-4fb4-824c-e4fa9299756e admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:14.031709 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-4ae80c3a-e8d6-4fb4-824c-e4fa9299756e admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Feb 09 13:04:14.032115 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 9/19] 10.222.0.84 () {54 vars in 930 bytes} [Wed Feb 9 13:04:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:04:14.089902 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-252f3d3e-fe7a-43c8-a6d5-fcc9c29c8401 admin admin] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:14.112915 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-252f3d3e-fe7a-43c8-a6d5-fcc9c29c8401 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.074647 Feb 09 13:04:14.127109 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 11/20] 10.222.0.84 () {60 vars in 1291 bytes} [Wed Feb 9 13:04:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:04:16.401939 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-4ae80c3a-e8d6-4fb4-824c-e4fa9299756e admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:16.403120 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-4ae80c3a-e8d6-4fb4-824c-e4fa9299756e admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001660 Feb 09 13:04:16.403574 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 10/21] 10.222.0.84 () {54 vars in 930 bytes} [Wed Feb 9 13:04:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:04:16.475843 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-267afc71-06b7-46a2-9f1d-20567869067e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "id": "1"}} {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:04:16.562528 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-267afc71-06b7-46a2-9f1d-20567869067e admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.152517 Feb 09 13:04:16.563164 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 12/22] 10.222.0.84 () {64 vars in 1282 bytes} [Wed Feb 9 13:04:16 2022] POST /compute/v2.1/flavors => generated 402 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 09 13:04:16.575664 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-816fd7b6-7d57-4cfe-82bc-2c2e2f5a85c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:04:16.659413 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-816fd7b6-7d57-4cfe-82bc-2c2e2f5a85c3 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087368 Feb 09 13:04:16.660004 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 11/23] 10.222.0.84 () {64 vars in 1332 bytes} [Wed Feb 9 13:04:16 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:04:18.965224 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-267afc71-06b7-46a2-9f1d-20567869067e admin admin] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:18.966516 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-267afc71-06b7-46a2-9f1d-20567869067e admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001877 Feb 09 13:04:18.967108 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 13/24] 10.222.0.84 () {54 vars in 930 bytes} [Wed Feb 9 13:04:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:04:19.025847 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-ffe20d36-9a03-4319-98ca-c3ea763dc4e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "swap": 0, "name": "m1.small", "disk": 20, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:04:19.108572 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-ffe20d36-9a03-4319-98ca-c3ea763dc4e9 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.133675 Feb 09 13:04:19.109152 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 12/25] 10.222.0.84 () {64 vars in 1282 bytes} [Wed Feb 9 13:04:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 09 13:04:19.122469 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-19014a6c-72cb-435c-bb8c-54062af6007f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:04:19.210246 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-19014a6c-72cb-435c-bb8c-54062af6007f admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092117 Feb 09 13:04:19.211181 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 14/26] 10.222.0.84 () {64 vars in 1332 bytes} [Wed Feb 9 13:04:19 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:04:21.501887 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-ffe20d36-9a03-4319-98ca-c3ea763dc4e9 admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:21.503010 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-ffe20d36-9a03-4319-98ca-c3ea763dc4e9 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Feb 09 13:04:21.503401 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 13/27] 10.222.0.84 () {54 vars in 930 bytes} [Wed Feb 9 13:04:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:04:21.560551 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-94d4ba47-b801-4de0-b442-56651318a3ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium"}} {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:04:21.650480 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-94d4ba47-b801-4de0-b442-56651318a3ec admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.140765 Feb 09 13:04:21.651061 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 15/28] 10.222.0.84 () {64 vars in 1282 bytes} [Wed Feb 9 13:04:21 2022] POST /compute/v2.1/flavors => generated 406 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 09 13:04:21.662722 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-ecd689a0-a705-4526-94d5-ba6bd7893df9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:04:21.763068 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-ecd689a0-a705-4526-94d5-ba6bd7893df9 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103987 Feb 09 13:04:21.770827 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 14/29] 10.222.0.84 () {64 vars in 1332 bytes} [Wed Feb 9 13:04:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:04:24.063806 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-94d4ba47-b801-4de0-b442-56651318a3ec admin admin] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:24.064809 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-94d4ba47-b801-4de0-b442-56651318a3ec admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Feb 09 13:04:24.065209 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 16/30] 10.222.0.84 () {54 vars in 930 bytes} [Wed Feb 9 13:04:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:04:24.126198 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-67cbc358-776f-4187-929b-d669e5d61904 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "rxtx_factor": 1.0, "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 80, "name": "m1.large"}} {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:04:24.307604 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-67cbc358-776f-4187-929b-d669e5d61904 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.235932 Feb 09 13:04:24.309798 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 15/31] 10.222.0.84 () {64 vars in 1282 bytes} [Wed Feb 9 13:04:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 09 13:04:24.320494 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-41d60a96-3c4e-4d11-ba27-c48eeb006efd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:04:24.442818 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-41d60a96-3c4e-4d11-ba27-c48eeb006efd admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126323 Feb 09 13:04:24.444204 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 17/32] 10.222.0.84 () {64 vars in 1332 bytes} [Wed Feb 9 13:04:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:04:26.737875 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-67cbc358-776f-4187-929b-d669e5d61904 admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:26.738927 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-67cbc358-776f-4187-929b-d669e5d61904 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Feb 09 13:04:26.742939 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 16/33] 10.222.0.84 () {54 vars in 930 bytes} [Wed Feb 9 13:04:26 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:04:26.807206 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-49783c21-4a18-4491-b6be-708a2ea6eb9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.xlarge", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "rxtx_factor": 1.0, "vcpus": 8, "disk": 160}} {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:04:26.883454 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-49783c21-4a18-4491-b6be-708a2ea6eb9a admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.138294 Feb 09 13:04:26.884397 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 18/34] 10.222.0.84 () {64 vars in 1282 bytes} [Wed Feb 9 13:04:26 2022] POST /compute/v2.1/flavors => generated 408 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 09 13:04:26.897518 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-d9346eef-5b71-4625-9196-b8619c8b9aa7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:04:27.003016 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-d9346eef-5b71-4625-9196-b8619c8b9aa7 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110174 Feb 09 13:04:27.003714 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 17/35] 10.222.0.84 () {64 vars in 1332 bytes} [Wed Feb 9 13:04:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:04:50.648455 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-49783c21-4a18-4491-b6be-708a2ea6eb9a admin admin] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:50.649461 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-49783c21-4a18-4491-b6be-708a2ea6eb9a admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Feb 09 13:04:50.649861 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 19/36] 10.222.0.84 () {54 vars in 930 bytes} [Wed Feb 9 13:04:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:04:50.706279 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-12214b92-34fe-4301-9b85-39889a14d470 admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:50.723362 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-12214b92-34fe-4301-9b85-39889a14d470 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067574 Feb 09 13:04:50.724747 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 18/37] 10.222.0.84 () {60 vars in 1291 bytes} [Wed Feb 9 13:04:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:04:52.106946 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-49783c21-4a18-4491-b6be-708a2ea6eb9a admin admin] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:52.107950 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-49783c21-4a18-4491-b6be-708a2ea6eb9a admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Feb 09 13:04:52.108383 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 20/38] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Feb 9 13:04:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:04:52.307821 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-3fe8209f-3596-4b28-99a9-b1f3a2c4aec5 admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:52.313260 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.wsgi [None req-3fe8209f-3596-4b28-99a9-b1f3a2c4aec5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 09 13:04:52.313823 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-3fe8209f-3596-4b28-99a9-b1f3a2c4aec5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:04:52.314641 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-3fe8209f-3596-4b28-99a9-b1f3a2c4aec5 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057852 Feb 09 13:04:52.315158 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 19/39] 10.222.0.84 () {60 vars in 1190 bytes} [Wed Feb 9 13:04:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 09 13:04:52.324488 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-6ff4b1fc-e945-4785-840f-f846f843ecb9 admin admin] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:52.344542 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-6ff4b1fc-e945-4785-840f-f846f843ecb9 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023603 Feb 09 13:04:52.345081 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 21/40] 10.222.0.84 () {60 vars in 1210 bytes} [Wed Feb 9 13:04:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:04:52.354983 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-1af175f5-8459-4eaa-b2cd-acc85fa4c192 admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:52.375923 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-1af175f5-8459-4eaa-b2cd-acc85fa4c192 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024369 Feb 09 13:04:52.376469 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 20/41] 10.222.0.84 () {60 vars in 1210 bytes} [Wed Feb 9 13:04:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:04:52.385492 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-834f507e-d8ab-453f-93c6-2f56b0786014 admin admin] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:52.391277 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.wsgi [None req-834f507e-d8ab-453f-93c6-2f56b0786014 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 09 13:04:52.391833 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-834f507e-d8ab-453f-93c6-2f56b0786014 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:04:52.392649 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-834f507e-d8ab-453f-93c6-2f56b0786014 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010645 Feb 09 13:04:52.393151 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 22/42] 10.222.0.84 () {60 vars in 1190 bytes} [Wed Feb 9 13:04:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 09 13:04:53.702144 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-1af175f5-8459-4eaa-b2cd-acc85fa4c192 admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:53.703262 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-1af175f5-8459-4eaa-b2cd-acc85fa4c192 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Feb 09 13:04:53.703830 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 21/43] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Feb 9 13:04:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:04:53.896921 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-de0df911-7e04-455a-862a-bff493c4c715 admin admin] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:53.902784 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.wsgi [None req-de0df911-7e04-455a-862a-bff493c4c715 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 09 13:04:53.903339 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-de0df911-7e04-455a-862a-bff493c4c715 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:04:53.904114 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-de0df911-7e04-455a-862a-bff493c4c715 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060342 Feb 09 13:04:53.904622 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 23/44] 10.222.0.84 () {60 vars in 1190 bytes} [Wed Feb 9 13:04:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 09 13:04:53.915054 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-d8b5e60b-d20f-4b99-840b-01a6c31928c7 admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:53.930049 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-d8b5e60b-d20f-4b99-840b-01a6c31928c7 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019482 Feb 09 13:04:53.930601 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 22/45] 10.222.0.84 () {60 vars in 1210 bytes} [Wed Feb 9 13:04:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:04:53.939965 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-bf7bd68f-361e-4eb9-b031-aa90cbbec182 admin admin] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:53.953351 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-bf7bd68f-361e-4eb9-b031-aa90cbbec182 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016856 Feb 09 13:04:53.953875 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 24/46] 10.222.0.84 () {60 vars in 1210 bytes} [Wed Feb 9 13:04:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:04:53.963525 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-73ddb268-a4eb-4c28-a3fb-b3551fdf5af5 admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:53.968649 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.wsgi [None req-73ddb268-a4eb-4c28-a3fb-b3551fdf5af5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 09 13:04:53.969195 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-73ddb268-a4eb-4c28-a3fb-b3551fdf5af5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:04:53.969959 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-73ddb268-a4eb-4c28-a3fb-b3551fdf5af5 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009969 Feb 09 13:04:53.970449 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 23/47] 10.222.0.84 () {60 vars in 1190 bytes} [Wed Feb 9 13:04:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 09 13:04:55.264941 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-bf7bd68f-361e-4eb9-b031-aa90cbbec182 admin admin] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:55.265938 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-bf7bd68f-361e-4eb9-b031-aa90cbbec182 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001718 Feb 09 13:04:55.266334 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 25/48] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Feb 9 13:04:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:04:55.454604 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-07831a3d-8e0b-4fdd-93d2-98e294797cb8 admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:55.459913 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.wsgi [None req-07831a3d-8e0b-4fdd-93d2-98e294797cb8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 09 13:04:55.460476 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-07831a3d-8e0b-4fdd-93d2-98e294797cb8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:04:55.461269 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-07831a3d-8e0b-4fdd-93d2-98e294797cb8 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057201 Feb 09 13:04:55.461780 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 24/49] 10.222.0.84 () {60 vars in 1193 bytes} [Wed Feb 9 13:04:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 09 13:04:55.471389 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-553f6a6f-b0a4-4a3b-94d5-b097b02af17b admin admin] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:55.485666 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-553f6a6f-b0a4-4a3b-94d5-b097b02af17b admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017994 Feb 09 13:04:55.486189 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 26/50] 10.222.0.84 () {60 vars in 1210 bytes} [Wed Feb 9 13:04:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:04:55.496584 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-956beb59-fe1d-41b3-adfe-82bc8c2c51fe admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:55.509704 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-956beb59-fe1d-41b3-adfe-82bc8c2c51fe admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017176 Feb 09 13:04:55.510214 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 25/51] 10.222.0.84 () {60 vars in 1210 bytes} [Wed Feb 9 13:04:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:04:55.519437 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-d439e928-5786-4bdf-bc38-76bacc82c045 admin admin] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:55.524588 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.wsgi [None req-d439e928-5786-4bdf-bc38-76bacc82c045 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 09 13:04:55.525144 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-d439e928-5786-4bdf-bc38-76bacc82c045 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:04:55.525920 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-d439e928-5786-4bdf-bc38-76bacc82c045 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009981 Feb 09 13:04:55.526405 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 27/52] 10.222.0.84 () {60 vars in 1193 bytes} [Wed Feb 9 13:04:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 09 13:04:56.846430 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-956beb59-fe1d-41b3-adfe-82bc8c2c51fe admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:56.847473 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-956beb59-fe1d-41b3-adfe-82bc8c2c51fe admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Feb 09 13:04:56.847870 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 26/53] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Feb 9 13:04:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:04:57.042840 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-be513a2f-7a63-4708-a6cc-bcb519addbdf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:04:57.152352 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-be513a2f-7a63-4708-a6cc-bcb519addbdf admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.159971 Feb 09 13:04:57.152821 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 28/54] 10.222.0.84 () {64 vars in 1235 bytes} [Wed Feb 9 13:04:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 09 13:04:58.419334 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-956beb59-fe1d-41b3-adfe-82bc8c2c51fe admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:58.420330 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-956beb59-fe1d-41b3-adfe-82bc8c2c51fe admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Feb 09 13:04:58.420726 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 27/55] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Feb 9 13:04:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:04:58.608676 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-e6d17bfa-231a-456c-895a-ca22b7c79d9b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:04:58.683224 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-e6d17bfa-231a-456c-895a-ca22b7c79d9b admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.124817 Feb 09 13:04:58.683770 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 29/56] 10.222.0.84 () {64 vars in 1235 bytes} [Wed Feb 9 13:04:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 09 13:04:59.962995 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-956beb59-fe1d-41b3-adfe-82bc8c2c51fe admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:04:59.964438 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-956beb59-fe1d-41b3-adfe-82bc8c2c51fe admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001885 Feb 09 13:04:59.964929 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 28/57] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Feb 9 13:04:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:05:00.156465 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-68e5f6dc-efd3-4165-8250-d48da64772cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:05:00.244189 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-68e5f6dc-efd3-4165-8250-d48da64772cb admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.138824 Feb 09 13:05:00.244721 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 30/58] 10.222.0.84 () {64 vars in 1235 bytes} [Wed Feb 9 13:05:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 09 13:05:01.533445 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-956beb59-fe1d-41b3-adfe-82bc8c2c51fe admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:05:01.534439 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-956beb59-fe1d-41b3-adfe-82bc8c2c51fe admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Feb 09 13:05:01.534940 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 29/59] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Feb 9 13:05:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:05:01.725857 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-f7404a9a-ddaf-4b51-93f7-9d4f665b24e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:05:01.797708 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-f7404a9a-ddaf-4b51-93f7-9d4f665b24e0 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.123152 Feb 09 13:05:01.798261 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 31/60] 10.222.0.84 () {64 vars in 1235 bytes} [Wed Feb 9 13:05:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 09 13:05:03.079610 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-956beb59-fe1d-41b3-adfe-82bc8c2c51fe admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:05:03.080609 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-956beb59-fe1d-41b3-adfe-82bc8c2c51fe admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Feb 09 13:05:03.081005 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 30/61] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Feb 9 13:05:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:05:03.273558 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-d4d97704-e2bd-4f69-8c89-b1a5593e4c1b admin admin] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:05:03.292352 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-d4d97704-e2bd-4f69-8c89-b1a5593e4c1b admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071071 Feb 09 13:05:03.292822 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 32/62] 10.222.0.84 () {60 vars in 1202 bytes} [Wed Feb 9 13:05:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:05:51.225260 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-956beb59-fe1d-41b3-adfe-82bc8c2c51fe admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:05:51.226256 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-956beb59-fe1d-41b3-adfe-82bc8c2c51fe admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Feb 09 13:05:51.226687 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 31/63] 10.222.0.84 () {54 vars in 930 bytes} [Wed Feb 9 13:05:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:05:51.283610 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-316a17a2-6ade-4e68-bc22-22f58cef94bb admin admin] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:05:51.302143 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-316a17a2-6ade-4e68-bc22-22f58cef94bb admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069589 Feb 09 13:05:51.302704 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 33/64] 10.222.0.84 () {60 vars in 1291 bytes} [Wed Feb 9 13:05:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:05:51.324619 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-5b54e9ff-1ea3-4722-a490-3452ea68a936 admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:05:51.332164 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-5b54e9ff-1ea3-4722-a490-3452ea68a936 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011083 Feb 09 13:05:51.333242 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 32/65] 10.222.0.84 () {60 vars in 1282 bytes} [Wed Feb 9 13:05:51 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:05:51.344102 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-f211878d-87a9-4023-92c4-3cd2afe94ffe admin admin] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:05:51.351538 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-f211878d-87a9-4023-92c4-3cd2afe94ffe admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010946 Feb 09 13:05:51.352047 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 34/66] 10.222.0.84 () {60 vars in 1285 bytes} [Wed Feb 9 13:05:51 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:05:51.363599 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-ace29efc-e8c0-45d5-911b-d547c9a8fead admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:05:51.371055 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-ace29efc-e8c0-45d5-911b-d547c9a8fead admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010929 Feb 09 13:05:51.371565 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 33/67] 10.222.0.84 () {60 vars in 1285 bytes} [Wed Feb 9 13:05:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:05:51.382884 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-722b3d27-4f7d-4028-a9a5-d63c5471f0b5 admin admin] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:05:51.390706 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-722b3d27-4f7d-4028-a9a5-d63c5471f0b5 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011514 Feb 09 13:05:51.391215 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 35/68] 10.222.0.84 () {60 vars in 1282 bytes} [Wed Feb 9 13:05:51 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:07:34.751902 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-068809a2-5026-4002-adfb-f971ad551a7b tempest-verify_tempest_config-675760309 tempest-verify_tempest_config-675760309-project] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:07:34.753859 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-068809a2-5026-4002-adfb-f971ad551a7b tempest-verify_tempest_config-675760309 tempest-verify_tempest_config-675760309-project] 10.222.0.84 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.107237 Feb 09 13:07:34.754390 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 34/69] 10.222.0.84 () {58 vars in 1133 bytes} [Wed Feb 9 13:07:34 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 09 13:09:12.556784 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-722b3d27-4f7d-4028-a9a5-d63c5471f0b5 admin admin] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:09:12.557796 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-722b3d27-4f7d-4028-a9a5-d63c5471f0b5 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Feb 09 13:09:12.558192 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 36/70] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Feb 9 13:09:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:09:12.814171 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-3202bead-a432-48ae-af09-408453f90fb9 admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:09:12.815367 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:09:12.815367 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: warnings.warn(msg) Feb 09 13:09:12.816921 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_concurrency.lockutils [None req-3202bead-a432-48ae-af09-408453f90fb9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:09:12.817363 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_concurrency.lockutils [None req-3202bead-a432-48ae-af09-408453f90fb9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:09:12.818194 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_concurrency.lockutils [None req-3202bead-a432-48ae-af09-408453f90fb9 admin admin] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:09:12.818653 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_concurrency.lockutils [None req-3202bead-a432-48ae-af09-408453f90fb9 admin admin] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:09:12.854221 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-3202bead-a432-48ae-af09-408453f90fb9 admin admin] 10.222.0.84 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.153268 Feb 09 13:09:12.854818 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 35/71] 10.222.0.84 () {60 vars in 1193 bytes} [Wed Feb 9 13:09:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 09 13:09:14.165616 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-722b3d27-4f7d-4028-a9a5-d63c5471f0b5 admin admin] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:09:14.166650 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-722b3d27-4f7d-4028-a9a5-d63c5471f0b5 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Feb 09 13:09:14.167043 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 37/72] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Feb 9 13:09:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:09:14.359294 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-62bf5d88-3457-4e34-ab47-d6a4a476e79d admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:09:14.360484 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:09:14.360484 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: warnings.warn(msg) Feb 09 13:09:14.361996 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_concurrency.lockutils [None req-62bf5d88-3457-4e34-ab47-d6a4a476e79d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:09:14.362460 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_concurrency.lockutils [None req-62bf5d88-3457-4e34-ab47-d6a4a476e79d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:09:14.363285 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_concurrency.lockutils [None req-62bf5d88-3457-4e34-ab47-d6a4a476e79d admin admin] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:09:14.363714 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_concurrency.lockutils [None req-62bf5d88-3457-4e34-ab47-d6a4a476e79d admin admin] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:09:14.382163 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-62bf5d88-3457-4e34-ab47-d6a4a476e79d admin admin] 10.222.0.84 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073673 Feb 09 13:09:14.382742 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 36/73] 10.222.0.84 () {60 vars in 1193 bytes} [Wed Feb 9 13:09:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 09 13:09:26.124806 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-722b3d27-4f7d-4028-a9a5-d63c5471f0b5 admin admin] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:09:26.125807 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-722b3d27-4f7d-4028-a9a5-d63c5471f0b5 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Feb 09 13:09:26.126202 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 38/74] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Feb 9 13:09:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:09:26.317103 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-31ac45cb-5a08-4f36-b6f7-01a45443cbe3 admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:09:26.318257 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:09:26.318257 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: warnings.warn(msg) Feb 09 13:09:26.319799 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_concurrency.lockutils [None req-31ac45cb-5a08-4f36-b6f7-01a45443cbe3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:09:26.320240 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_concurrency.lockutils [None req-31ac45cb-5a08-4f36-b6f7-01a45443cbe3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:09:26.321067 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_concurrency.lockutils [None req-31ac45cb-5a08-4f36-b6f7-01a45443cbe3 admin admin] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:09:26.321488 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_concurrency.lockutils [None req-31ac45cb-5a08-4f36-b6f7-01a45443cbe3 admin admin] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:09:26.346354 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-31ac45cb-5a08-4f36-b6f7-01a45443cbe3 admin admin] 10.222.0.84 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079609 Feb 09 13:09:26.346928 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 37/75] 10.222.0.84 () {60 vars in 1193 bytes} [Wed Feb 9 13:09:26 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:09:27.662804 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: DEBUG nova.api.openstack.wsgi [None req-722b3d27-4f7d-4028-a9a5-d63c5471f0b5 admin admin] Calling method '>' {{(pid=102422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:09:27.663860 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: INFO nova.api.openstack.requestlog [None req-722b3d27-4f7d-4028-a9a5-d63c5471f0b5 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Feb 09 13:09:27.664259 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: [pid: 102422|app: 0|req: 39/76] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Feb 9 13:09:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:09:27.854728 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG nova.api.openstack.wsgi [None req-fb2789ac-cc40-41c2-8ab7-d2844fabb948 admin admin] Calling method '>' {{(pid=102421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:09:27.860368 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:09:27.860368 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: warnings.warn(msg) Feb 09 13:09:27.860368 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_concurrency.lockutils [None req-fb2789ac-cc40-41c2-8ab7-d2844fabb948 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:09:27.860368 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_concurrency.lockutils [None req-fb2789ac-cc40-41c2-8ab7-d2844fabb948 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:09:27.860368 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_concurrency.lockutils [None req-fb2789ac-cc40-41c2-8ab7-d2844fabb948 admin admin] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:09:27.860368 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: DEBUG oslo_concurrency.lockutils [None req-fb2789ac-cc40-41c2-8ab7-d2844fabb948 admin admin] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:09:27.879409 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: INFO nova.api.openstack.requestlog [None req-fb2789ac-cc40-41c2-8ab7-d2844fabb948 admin admin] 10.222.0.84 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.075435 Feb 09 13:09:27.879947 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: [pid: 102421|app: 0|req: 38/77] 10.222.0.84 () {60 vars in 1193 bytes} [Wed Feb 9 13:09:27 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:10:28.519995 dv-cinder-827860-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 09 13:10:28.520589 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: Wed Feb 9 13:10:28 2022 - graceful shutdown triggered... Feb 09 13:10:28.521049 dv-cinder-827860-3-iscsi devstack@n-api.service[102421]: Gracefully killing worker 1 (pid: 102421)... Feb 09 13:10:28.521412 dv-cinder-827860-3-iscsi devstack@n-api.service[102422]: Gracefully killing worker 2 (pid: 102422)... Feb 09 13:10:29.521522 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: worker 1 buried after 1 seconds Feb 09 13:10:29.521522 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: worker 2 buried after 1 seconds Feb 09 13:10:29.521522 dv-cinder-827860-3-iscsi devstack@n-api.service[102420]: goodbye to uWSGI. Feb 09 13:10:29.523428 dv-cinder-827860-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Feb 09 13:10:29.524012 dv-cinder-827860-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 09 13:10:29.527066 dv-cinder-827860-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 09 13:10:29.543628 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 09 13:10:29.545638 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Feb 9 13:10:29 2022] *** Feb 09 13:10:29.545638 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 09 13:10:29.545638 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 09 13:10:29.545638 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: nodename: dv-cinder-827860-3-iscsi Feb 09 13:10:29.545638 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: machine: x86_64 Feb 09 13:10:29.545638 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: clock source: unix Feb 09 13:10:29.545638 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: pcre jit disabled Feb 09 13:10:29.545638 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: detected number of CPU cores: 4 Feb 09 13:10:29.545638 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: current working directory: / Feb 09 13:10:29.545638 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: detected binary path: /usr/bin/uwsgi-core Feb 09 13:10:29.546394 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: your processes number limit is 47680 Feb 09 13:10:29.546394 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: your memory page size is 4096 bytes Feb 09 13:10:29.546394 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: detected max file descriptor number: 2048 Feb 09 13:10:29.546394 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: lock engine: pthread robust mutexes Feb 09 13:10:29.546394 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: thunder lock: enabled Feb 09 13:10:29.546394 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 09 13:10:29.546394 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 09 13:10:29.593254 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: Python main interpreter initialized at 0x55de65de29c0 Feb 09 13:10:29.593254 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: python threads support enabled Feb 09 13:10:29.593254 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: your server socket listen backlog is limited to 100 connections Feb 09 13:10:29.593254 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: your mercy for graceful operations on workers is 90 seconds Feb 09 13:10:29.593689 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: mapped 403077 bytes (393 KB) for 2 cores Feb 09 13:10:29.593689 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: *** Operational MODE: preforking *** Feb 09 13:10:29.593983 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: *** uWSGI is running in multiple interpreter mode *** Feb 09 13:10:29.593983 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: spawned uWSGI master process (pid: 116731) Feb 09 13:10:29.594183 dv-cinder-827860-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 09 13:10:29.594853 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: spawned uWSGI worker 1 (pid: 116748, cores: 1) Feb 09 13:10:29.595377 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: spawned uWSGI worker 2 (pid: 116749, cores: 1) Feb 09 13:10:29.595669 dv-cinder-827860-3-iscsi devstack@n-api.service[116731]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 09 13:10:31.579285 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 09 13:10:31.579285 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: from cryptography.utils import int_from_bytes Feb 09 13:10:31.580029 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 09 13:10:31.580029 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: from cryptography.utils import int_from_bytes Feb 09 13:10:31.601431 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 09 13:10:31.601431 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: from cryptography.utils import int_from_bytes Feb 09 13:10:31.602196 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 09 13:10:31.602196 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: from cryptography.utils import int_from_bytes Feb 09 13:10:34.036367 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 09 13:10:34.036967 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 09 13:10:34.037047 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 09 13:10:34.037410 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 09 13:10:34.037668 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 09 13:10:34.038070 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.038401 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.038754 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.039081 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.039419 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.039736 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.040656 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.041053 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.041389 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.041657 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.041981 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.042314 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-827860-3-iscsi {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.042669 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.042988 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.043309 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.043638 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.043950 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.044278 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.044593 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.045101 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.052243 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.052243 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.052243 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.052243 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.052243 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.052243 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.052753 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 09 13:10:34.053174 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.053248 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 09 13:10:34.053326 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.053326 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.053475 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 09 13:10:34.053546 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.053635 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 09 13:10:34.053719 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-827860-3-iscsi {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.053791 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 09 13:10:34.053873 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.053954 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.054028 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.054104 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.054183 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.054260 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.054260 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.054426 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.054426 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.054589 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.054666 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.054757 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.054838 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.054916 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.054986 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.055054 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.055121 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.055219 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.055219 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.055361 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.055438 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.055515 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.055595 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-827860-3-iscsi {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.055678 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.056356 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.056440 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.056511 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.056587 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.056666 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.056737 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.056737 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.056880 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.056880 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.057021 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.057021 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.057159 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.057319 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.057400 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.057471 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.057539 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.057636 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.057722 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.057801 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.057872 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.057950 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.058027 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.058109 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.058109 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.058244 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.058323 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.058413 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.058493 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.061458 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.061698 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.061872 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.063724 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.063900 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.064075 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.064242 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.064400 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.064550 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.064704 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.064704 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.064993 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-827860-3-iscsi {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.065149 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.065149 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.065429 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.065598 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.065598 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.065598 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.066081 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.066233 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.066377 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.066534 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.066534 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.066534 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.84 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.066975 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.067119 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.84 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.067119 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.067482 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.067641 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.067641 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.067926 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.068069 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.068220 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.068373 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.068373 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.068653 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.068795 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.068795 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.069085 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.069236 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.069236 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.069699 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.069860 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.070003 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.070155 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.070310 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.070469 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.070869 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.071114 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.071114 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.071487 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.071642 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.071642 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.071642 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.072064 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.072780 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.073165 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.073318 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.073475 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.073475 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.075410 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.075588 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.075588 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.075863 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.076015 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.076015 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.076312 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.076471 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.076471 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.076755 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.076899 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.076899 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.077184 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.077336 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.077336 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.077625 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.079599 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.079599 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.079932 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.080079 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.080079 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.080363 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.080517 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.080743 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.080898 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.081049 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.081204 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.081349 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.081534 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.081700 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.081872 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.082016 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.082159 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.082303 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.082811 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.083072 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.083391 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.083550 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.083709 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.083861 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.084005 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.84 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.084148 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.084299 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.84 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.084469 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.084631 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.084783 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.084927 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.085090 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.085458 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.085624 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.085777 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.085927 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.086072 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.086215 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.086357 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.086514 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.086854 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.087011 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.087174 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.087326 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.087479 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.087636 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.087791 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.087942 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.088099 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.088243 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.088399 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.088551 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.088697 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.088858 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.089010 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.089164 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.091018 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.091176 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.091328 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.091481 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.091634 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.091792 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.091944 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.092094 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.092245 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.092389 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.092575 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.093106 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.093548 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.093702 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.093848 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.093999 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.094144 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.097006 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.097222 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.097392 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.097557 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.097714 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.097878 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.098043 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.098198 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.098351 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.098502 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.098683 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.098914 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.099062 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.099216 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.099360 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.099503 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.099646 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.099799 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.099969 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.100122 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.100266 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.100408 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.100550 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.100702 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.100853 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.101009 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.101167 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.101312 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.101466 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.101618 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.101779 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.101935 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.102092 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.102246 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.102389 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.102540 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.103933 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.104094 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.104094 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.104376 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.104527 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.104671 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.104813 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.104976 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.105121 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.105263 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.105406 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.105557 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.105701 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.105857 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.106001 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.106143 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.106286 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.106286 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.106573 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.106741 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.106904 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.107309 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.107594 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.107767 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.107922 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.108074 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.108225 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.108375 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.108520 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.108663 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.108814 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.108957 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.109107 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.109269 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.109420 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.109565 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.109716 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.109874 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.109874 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.110169 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.110318 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 13:10:34.110462 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.110647 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.110807 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.110973 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.111118 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.111274 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.111417 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.111568 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.111804 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.111960 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.112106 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.112265 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.112409 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.112560 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.112717 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.112861 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.113010 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.113166 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.113486 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.114034 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.114197 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.114342 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.114486 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.114486 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.114812 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.114812 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.115105 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.115250 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.115393 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.115544 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.115713 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.115868 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.115868 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.116195 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.116195 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.116520 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.116672 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.116828 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.116981 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.117151 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.117151 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.117625 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.117625 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.117933 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.118078 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.118870 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.119043 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.119198 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.119356 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.119503 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.119647 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.119905 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.120084 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.120232 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.120390 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.120554 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.120699 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.120849 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.121003 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.121147 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.121299 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.121451 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.121595 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.121746 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.121898 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.122051 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.122195 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.122338 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.122501 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.122671 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.122816 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.122972 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.123128 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.123281 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.123604 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.123774 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.124327 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.124487 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.124633 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.124633 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.125058 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.125058 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.125354 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.125354 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.125651 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.125796 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.125946 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.126090 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.126246 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.126397 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.126541 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.126708 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.126863 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.127018 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.127170 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.127322 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.127703 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.127863 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.128007 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.128164 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.128387 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.128535 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.128688 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.128840 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.128984 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.129134 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.129304 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.129450 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.129602 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.129753 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.129905 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.130057 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.130210 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.130362 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.130527 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.130845 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.131027 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.131190 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.131336 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.131506 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.131652 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.131803 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.131955 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.132107 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.132251 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.132394 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.132394 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.132394 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.132394 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.132394 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.133085 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.133237 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.133391 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.133554 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.134351 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.134510 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.134681 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.134839 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.135002 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.135147 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.135147 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.135442 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.135587 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.135587 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.135587 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.135587 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.135587 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.136285 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.136435 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.136587 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.136741 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.136895 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.137048 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.137193 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.137344 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.137497 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.137641 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.138006 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.138169 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.138169 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.138470 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.139023 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.139193 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.139350 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.139495 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.139639 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.139783 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.139927 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.140079 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.140237 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.140393 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.140536 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.140689 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.140850 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.141007 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.141167 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.141314 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.141457 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.141599 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.141752 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.141942 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.142101 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.142253 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.142408 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.142568 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.142720 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.142876 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.143028 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.143185 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.143337 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.143481 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.143625 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.143625 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.144071 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.144071 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.144729 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.144729 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.145098 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.145255 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.145407 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.145590 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.145738 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.145882 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.146025 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.146182 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.146335 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.146488 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.146666 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.146812 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.146974 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.147381 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.147538 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.147538 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.147811 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.148162 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.148381 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.148557 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.148711 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.148858 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.149002 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.149146 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.149321 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.149504 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.149654 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.149878 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.150035 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.150188 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.150345 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.150499 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.150681 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.150834 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.150982 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.151139 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.151283 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.151283 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.151584 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.151736 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.151881 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.152033 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.152178 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.152328 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.152471 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.152615 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.152758 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.152959 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.153117 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.153262 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.153417 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.153562 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.153712 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.154024 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.154179 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.154341 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.154950 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.155104 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.155249 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.155406 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.155560 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.155706 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.155859 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.156022 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.156181 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.156327 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.156478 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.156622 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.156622 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.156892 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.157049 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.157194 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.157346 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.157504 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.157649 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.157800 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.157971 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.158142 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.158481 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.158655 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.158800 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.158945 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.159101 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.159254 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.159398 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.159548 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.159704 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.159928 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.160094 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.160240 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.160383 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.160534 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.160677 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.160844 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.160990 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.161133 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.161277 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.161420 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.161570 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.161723 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.161866 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.162021 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.162172 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.162316 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.162467 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.162646 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.162810 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.162963 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.163108 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.163250 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.163406 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.163558 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.163702 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.163853 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.164324 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.164491 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.164819 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.165710 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.165866 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.166011 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.166156 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.166310 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.166468 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.166684 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.166834 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.166978 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.167133 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.167278 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.167430 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.167574 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.167717 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.167860 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.168012 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.168012 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.168293 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.168633 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.168797 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.168952 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.169097 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.169266 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.169421 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.169572 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.170428 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.170611 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.170764 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.170909 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.171064 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.171229 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.171386 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.171541 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.171686 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.171959 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.172132 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.172278 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.172431 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.172584 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.172736 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.172893 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.173038 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.173181 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.173333 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.173477 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.173477 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.173755 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.173907 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.174061 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.174218 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.174511 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.174915 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.175099 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.175323 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.175492 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.175806 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.175968 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.176121 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.176267 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.176418 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.176577 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.176735 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.176890 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.177034 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.177177 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.177327 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.177480 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.177624 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.177777 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.177920 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.178107 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.178256 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.178408 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.178599 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.178599 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.179081 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.179236 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.179394 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.179539 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.179695 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.179840 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.179991 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.180142 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.180295 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.180295 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.181782 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.181947 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.182102 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.182254 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.182405 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.182549 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.182974 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.182974 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.183262 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.183407 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.183570 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.183757 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.183929 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.184076 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.184234 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.184387 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.184707 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.185054 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.185054 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.185611 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.185933 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.186096 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.186241 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.186396 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.186614 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.186790 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.186935 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.187086 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.187231 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.187384 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.187537 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.187690 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.187834 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.187985 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.188129 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.188282 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.188433 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.188585 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.188773 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.189138 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.189292 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.189437 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.189580 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.189723 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.189896 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.190650 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.190808 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.190955 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.191112 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.191263 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.191506 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.191654 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.191807 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.191952 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.192095 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.192239 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.192392 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.192544 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.192699 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.192852 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.192996 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.193147 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.193304 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.193461 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.193605 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.193748 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.193899 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.194288 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.195325 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.195325 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.195483 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.195555 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.195634 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.195717 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.195788 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.195857 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.195940 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.196015 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.196091 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.196174 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.196174 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.196339 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.196427 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.196509 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.196598 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.196693 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.196777 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.196864 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.196947 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.197035 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.197130 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.197222 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.197305 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.197386 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.197466 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.197553 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.197648 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.197731 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.197819 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.197908 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.197991 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.198071 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.198159 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.198242 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.198322 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.198408 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.198493 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.198588 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.198676 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.198754 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.198824 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.198898 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.198967 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.199042 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.199118 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.199194 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.199270 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.199339 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.199407 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.199482 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.199551 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.199629 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.199712 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.199800 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.199883 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.199976 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.200059 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.200139 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.200229 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.200327 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.200409 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.200503 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.200587 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.200667 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.200755 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.200842 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.200930 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.201019 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.201101 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.201181 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.201262 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.201341 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.201434 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.201524 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.201614 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.201703 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.201793 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.201875 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.201964 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.202054 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.202136 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.202217 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.202306 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.202394 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.202488 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.202788 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.202894 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.202973 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.203044 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.203112 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.203189 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.203266 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.203335 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.203402 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.203476 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.203582 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.203679 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.203768 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.203870 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.204014 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.204099 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.204193 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.204277 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.204357 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.204447 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.204537 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.204615 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.204706 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.204791 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.204868 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.204949 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.205025 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.205108 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.205202 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.205284 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.205371 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.205453 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.205541 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.205633 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.205717 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.205788 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.205863 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.205938 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.206006 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.206081 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.206162 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.206241 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.206324 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.206401 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.206470 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.206581 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.206737 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.206833 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.206923 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.207006 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.207094 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.207186 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.207269 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.207350 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.207438 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.207521 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.207610 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.207717 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.207798 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.207881 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.207972 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.208056 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.208155 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.208239 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.208328 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.208412 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.208493 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.208575 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.208665 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.208756 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.208839 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.208921 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.209009 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.209099 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.209192 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.209276 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.209364 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.209452 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.209530 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.209667 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.209747 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.209841 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.209932 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.210022 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.210022 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.210022 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.210247 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.210335 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.210425 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.210508 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.210616 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.210716 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.210807 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.210897 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.210986 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.211069 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.211152 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.211243 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.211326 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.211413 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.211496 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.211584 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.211674 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.211753 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.211822 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.211891 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.212494 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.212566 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.212652 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.212731 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.212800 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.212868 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.212942 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.213018 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.213099 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.213175 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.213258 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.213347 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.213436 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.213525 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.213616 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.214132 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.214268 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.214384 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.214493 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.214696 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.214814 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.214930 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.215041 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.215149 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.215257 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.215373 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.215373 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.215584 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.215693 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.215799 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.215906 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.216025 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.216141 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.216257 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.216366 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.216474 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.216581 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.216697 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.216814 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.216936 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.217044 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.217159 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.217267 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.217380 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.217488 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.217597 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.217704 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.217820 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.217929 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.218043 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.218151 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.218151 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.218363 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.218473 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.218609 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.218723 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.218831 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.218939 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.219058 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.219168 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.219276 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.219390 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.219507 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.219624 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.219746 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.219855 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.219962 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.220076 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.220185 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.220293 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.220410 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.220518 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.220625 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.220740 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.220848 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.220971 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.221081 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.221178 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.221270 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.221354 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.221354 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.221509 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.221600 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.221600 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.221764 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.221847 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.221935 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.222027 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.222110 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.222199 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.222287 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.222377 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.222459 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.222549 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.222777 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.222881 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.223109 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.223210 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.223438 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.223530 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.223766 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.223856 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.224085 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.224181 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.224398 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.224491 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.224711 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.224807 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.225019 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.225118 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.225366 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.225459 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.225675 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.225800 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.226052 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.226166 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.226338 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.226468 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.226690 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.226840 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.227024 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.227366 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.228219 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.228520 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.228697 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.228850 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.228997 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.229162 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.229311 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.229459 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.229606 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.229780 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.229934 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.230095 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.230263 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.230412 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.230585 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.230740 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.230899 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.231055 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.231213 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.231370 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.231569 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.231899 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.232231 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.232563 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.232942 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.233104 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.233328 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.233537 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.233705 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.234006 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.234142 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.234260 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.234384 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.234536 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.234852 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.234939 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.235021 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.235204 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.235295 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.235528 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.235629 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.235853 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.235951 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.236176 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.236267 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.236500 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.236591 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.236822 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.236928 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.237158 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.237256 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.237477 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.237569 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.237810 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.237906 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.238141 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.238242 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.238479 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.238589 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.238849 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.238940 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.239178 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.239282 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.239504 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.239596 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.239852 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.239951 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.240182 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.240280 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.240502 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.240593 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.240825 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.240914 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.241149 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.241248 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.241472 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.241600 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.241791 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.241914 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.242122 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.242247 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.242424 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.242521 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.242771 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.242861 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.243093 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.243208 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.243444 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.243556 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.243762 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.243854 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.244081 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.244171 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.244397 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.244492 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.244738 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.244838 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.245062 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.245168 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.245383 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.245479 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.245707 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.245810 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.246028 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.246125 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.246351 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.246549 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.246714 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.246910 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.247040 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.247254 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.247352 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.247589 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.247689 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.247925 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.248023 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.248258 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.248357 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.248583 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.248689 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.248918 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.249009 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.249233 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.249332 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.249547 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.249652 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.249868 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.249986 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.250188 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.250290 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.250501 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.250692 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.250860 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.250957 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.251179 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.251269 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.251491 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.251583 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.251843 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.251975 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.252129 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.252230 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.252491 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.252663 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.252824 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.253022 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.253345 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.253447 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.253680 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.253771 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.254014 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.254104 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.254338 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.254439 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.254687 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.254792 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.255018 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.255117 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.255330 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.255462 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.255645 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.255745 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.255968 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.256065 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.256284 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.256388 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.256597 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.256688 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.256909 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.257007 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.257230 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.257324 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.257586 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.257675 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.257930 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.258009 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.258258 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.258341 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.258587 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.258682 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.258955 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.259049 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.259268 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.259349 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.259580 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.259662 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.259892 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.259979 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.260210 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.260299 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.260553 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.260644 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.260831 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.260938 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.261143 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.261224 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.261454 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.261548 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.261797 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.262012 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.262103 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.262174 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.262473 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.262667 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.262762 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.263450 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.263536 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.263607 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.263685 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.263755 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.263832 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.263937 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.264018 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.264282 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.264371 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.264610 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.264719 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.264923 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.265014 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.265246 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.265345 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.265565 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.265656 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.265894 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.265985 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.266210 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.266438 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.266538 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.266799 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.266911 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.267147 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.267248 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.267492 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.267738 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.267840 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.268080 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.268175 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.268410 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.268510 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.268751 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.268849 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.269090 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.269188 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.269405 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.269505 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.269781 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.269918 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.270037 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.270149 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.270342 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.270474 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.270707 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.270799 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.271038 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.271140 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.271359 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.271450 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.271676 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.271775 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.271996 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.272418 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.272565 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.272807 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.272937 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.273183 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.273336 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.273511 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.273642 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.273853 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.273962 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.274179 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.274293 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.275046 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.275174 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.275370 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.275466 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.275705 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.275804 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.276024 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.276125 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.276347 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.276438 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.276672 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.276775 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.276989 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.277091 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.277306 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.277407 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.277621 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.277722 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.277936 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.278037 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.278256 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.278350 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.278614 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.278722 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.278938 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.279039 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.279250 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.279343 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.279588 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.279689 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.279915 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.280019 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.280234 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.280326 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.280554 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.280656 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.280880 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.280974 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.281197 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.281288 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.281515 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.281622 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.281836 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.281936 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.282156 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.282305 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.282471 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.282585 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.282832 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.282942 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.283174 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.283274 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.283479 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.283588 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.283806 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.283924 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.284117 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.284222 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.284430 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.284539 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.284741 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.284851 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.285074 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.285193 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.285396 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.285498 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.285731 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.285833 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.286051 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.286160 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.286422 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.286540 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.286712 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.286806 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.287031 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.287142 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.287348 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.287442 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.287675 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.287774 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.288004 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.288106 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.288325 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.288553 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.288655 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.288908 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.289050 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.289345 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.289464 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.289592 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.289686 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.289947 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.290112 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.291058 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.291185 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.291275 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.291359 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.291497 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.291600 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.291837 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.291931 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.292165 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.292274 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.292495 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.292615 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.292820 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.292913 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.293144 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.293247 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.293482 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.293583 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.293784 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.293875 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.294102 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.294208 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.294428 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.294532 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.294768 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.294876 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.295093 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.295186 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.295411 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.295512 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.295728 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.295832 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.296050 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.296151 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.296377 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.296478 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.296711 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.296803 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.297040 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.297141 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.297372 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.297472 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.297697 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.297789 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.298022 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.298125 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.298348 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.298440 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.298699 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.298829 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.299083 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.299237 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.299384 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.299532 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.299678 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.299820 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.299975 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.300126 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.300269 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 09 13:10:34.300420 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.300744 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.301078 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.301415 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.301744 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.302083 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.302417 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.302769 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.303104 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.303479 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.303772 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.304131 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.304478 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.304819 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.305140 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.305460 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.305803 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.306128 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.306475 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.306846 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.307178 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.307516 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.307880 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.308226 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.308551 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.308889 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.309227 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.309559 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.309911 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.310241 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.310583 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.310915 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.311242 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.311570 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.311897 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.312225 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.312565 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.312905 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.313226 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.313590 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.313894 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.314228 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.314575 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.314908 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.315252 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.315581 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.315909 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.316233 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.316562 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.316895 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.317226 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.317570 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.317915 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.318262 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.318628 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.318993 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.319322 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.319684 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.320068 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.321004 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.321369 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.321791 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 13:10:34.322459 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 09 13:10:34.323843 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_db.sqlalchemy.engines [None req-195966fc-9f29-471d-8269-0a3534a89419 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116749) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 09 13:10:34.345619 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_db.sqlalchemy.engines [None req-3272954c-13fc-4240-94c5-a1e756437305 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116748) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 09 13:10:34.387989 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.context [None req-195966fc-9f29-471d-8269-0a3534a89419 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e47d22a-5d94-47f3-baff-22c6e92e901b(cell1) {{(pid=116749) load_cells /opt/stack/nova/nova/context.py:464}} Feb 09 13:10:34.392247 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-195966fc-9f29-471d-8269-0a3534a89419 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:10:34.393837 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-195966fc-9f29-471d-8269-0a3534a89419 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:10:34.394726 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-195966fc-9f29-471d-8269-0a3534a89419 None None] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:10:34.396646 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-195966fc-9f29-471d-8269-0a3534a89419 None None] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:10:34.408241 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_db.sqlalchemy.engines [None req-195966fc-9f29-471d-8269-0a3534a89419 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116749) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 09 13:10:34.409543 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_db.sqlalchemy.engines [None req-195966fc-9f29-471d-8269-0a3534a89419 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116749) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 09 13:10:34.410818 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.context [None req-3272954c-13fc-4240-94c5-a1e756437305 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e47d22a-5d94-47f3-baff-22c6e92e901b(cell1) {{(pid=116748) load_cells /opt/stack/nova/nova/context.py:464}} Feb 09 13:10:34.415765 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3272954c-13fc-4240-94c5-a1e756437305 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:10:34.417478 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3272954c-13fc-4240-94c5-a1e756437305 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:10:34.418715 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3272954c-13fc-4240-94c5-a1e756437305 None None] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:10:34.420737 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3272954c-13fc-4240-94c5-a1e756437305 None None] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:10:34.431583 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_db.sqlalchemy.engines [None req-3272954c-13fc-4240-94c5-a1e756437305 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116748) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 09 13:10:34.432464 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_db.sqlalchemy.engines [None req-3272954c-13fc-4240-94c5-a1e756437305 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116748) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 09 13:10:34.571249 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_db.sqlalchemy.engines [None req-195966fc-9f29-471d-8269-0a3534a89419 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116749) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 09 13:10:34.591637 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_db.sqlalchemy.engines [None req-3272954c-13fc-4240-94c5-a1e756437305 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116748) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 09 13:10:34.896391 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: WARNING keystonemiddleware.auth_token [None req-195966fc-9f29-471d-8269-0a3534a89419 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 09 13:10:34.903829 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: WARNING keystonemiddleware.auth_token [None req-195966fc-9f29-471d-8269-0a3534a89419 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 09 13:10:34.914844 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: WARNING keystonemiddleware.auth_token [None req-3272954c-13fc-4240-94c5-a1e756437305 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 09 13:10:34.921509 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: WARNING keystonemiddleware.auth_token [None req-3272954c-13fc-4240-94c5-a1e756437305 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 09 13:10:35.245469 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: WARNING keystonemiddleware.auth_token [None req-195966fc-9f29-471d-8269-0a3534a89419 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 09 13:10:35.250850 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: WARNING keystonemiddleware.auth_token [None req-195966fc-9f29-471d-8269-0a3534a89419 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 09 13:10:35.256057 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55de65de29c0 pid: 116749 (default app) Feb 09 13:10:35.262750 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: WARNING keystonemiddleware.auth_token [None req-3272954c-13fc-4240-94c5-a1e756437305 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 09 13:10:35.267974 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: WARNING keystonemiddleware.auth_token [None req-3272954c-13fc-4240-94c5-a1e756437305 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 09 13:10:35.273443 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55de65de29c0 pid: 116748 (default app) Feb 09 13:11:12.104114 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-dd2bf1b1-021f-4174-a3c3-274686a9b3db tempest-VolumesGetTestJSON-1368891026 tempest-VolumesGetTestJSON-1368891026-project] Action: 'create', calling method: .version_select at 0x7f7f666a6280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1014322624", "metadata": {"Type": "work"}}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:11:13.888176 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-ae3b0d83-090a-4098-9fd8-82ee55c362ce tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1290207879", "imageRef": "af86cedd-e7d5-4a28-a810-f47830f4bffc", "flavorRef": "452", "networks": [{"uuid": "d83fb912-c237-4d7d-9793-a53c546bf725"}]}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:11:14.402932 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.network.neutron [None req-ae3b0d83-090a-4098-9fd8-82ee55c362ce tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] validate_networks() for [('d83fb912-c237-4d7d-9793-a53c546bf725', None, None, None, None, None)] {{(pid=116748) validate_networks /opt/stack/nova/nova/network/neutron.py:2554}} Feb 09 13:11:14.471047 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-dd2bf1b1-021f-4174-a3c3-274686a9b3db tempest-VolumesGetTestJSON-1368891026 tempest-VolumesGetTestJSON-1368891026-project] 10.222.0.84 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.127994 Feb 09 13:11:14.474371 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 1/1] 10.222.0.84 () {60 vars in 1155 bytes} [Wed Feb 9 13:11:11 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3133 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 09 13:11:14.486108 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-110ff1bc-f0af-407d-bf77-121ebbdc576c tempest-VolumesGetTestJSON-1368891026 tempest-VolumesGetTestJSON-1368891026-project] Calling method '.version_select at 0x7f7f6655ce50>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:14.633032 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-110ff1bc-f0af-407d-bf77-121ebbdc576c tempest-VolumesGetTestJSON-1368891026 tempest-VolumesGetTestJSON-1368891026-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/717829f6-9c9d-4e01-b18b-c82aa146af93" status: 200 len: 353 microversion: 2.1 time: 0.152156 Feb 09 13:11:14.634653 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 2/2] 10.222.0.84 () {58 vars in 1244 bytes} [Wed Feb 9 13:11:14 2022] GET /compute/v2.1/os-volumes/717829f6-9c9d-4e01-b18b-c82aa146af93 => generated 353 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:11:15.634206 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-ae3b0d83-090a-4098-9fd8-82ee55c362ce tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Flavor limits 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 09 13:11:15.634776 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-ae3b0d83-090a-4098-9fd8-82ee55c362ce tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Image limits 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 09 13:11:15.635136 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-ae3b0d83-090a-4098-9fd8-82ee55c362ce tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Flavor pref 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 09 13:11:15.635558 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-ae3b0d83-090a-4098-9fd8-82ee55c362ce tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Image pref 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 09 13:11:15.635997 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-ae3b0d83-090a-4098-9fd8-82ee55c362ce tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 09 13:11:15.652769 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ae3b0d83-090a-4098-9fd8-82ee55c362ce tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:15.653010 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-e26f2abf-cf59-4481-914e-b20f6f34d75c tempest-VolumesGetTestJSON-1368891026 tempest-VolumesGetTestJSON-1368891026-project] Calling method '.version_select at 0x7f7f666a6ca0>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:15.653460 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ae3b0d83-090a-4098-9fd8-82ee55c362ce tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:15.653460 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ae3b0d83-090a-4098-9fd8-82ee55c362ce tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:15.653460 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ae3b0d83-090a-4098-9fd8-82ee55c362ce tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:15.746974 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-ae3b0d83-090a-4098-9fd8-82ee55c362ce tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Getting quotas for project cfd874f35c2a4960b06af720a09e2d9f. Resources: {'instances', 'cores', 'ram'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:11:15.770145 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-ae3b0d83-090a-4098-9fd8-82ee55c362ce tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Getting quotas for user c855a6b9dc36484195969a2dd6f3fc6c and project cfd874f35c2a4960b06af720a09e2d9f. Resources: {'instances', 'cores', 'ram'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:11:15.794494 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-ae3b0d83-090a-4098-9fd8-82ee55c362ce tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Going to run 1 instances... {{(pid=116748) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 09 13:11:15.797513 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-ae3b0d83-090a-4098-9fd8-82ee55c362ce tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af86cedd-e7d5-4a28-a810-f47830f4bffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 09 13:11:15.908513 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-e26f2abf-cf59-4481-914e-b20f6f34d75c tempest-VolumesGetTestJSON-1368891026 tempest-VolumesGetTestJSON-1368891026-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/717829f6-9c9d-4e01-b18b-c82aa146af93" status: 200 len: 353 microversion: 2.1 time: 0.263618 Feb 09 13:11:15.909172 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 3/3] 10.222.0.84 () {58 vars in 1244 bytes} [Wed Feb 9 13:11:15 2022] GET /compute/v2.1/os-volumes/717829f6-9c9d-4e01-b18b-c82aa146af93 => generated 353 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:11:16.057024 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-ae3b0d83-090a-4098-9fd8-82ee55c362ce tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.806085 Feb 09 13:11:16.057693 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 1/4] 10.222.0.84 () {60 vars in 1146 bytes} [Wed Feb 9 13:11:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 09 13:11:16.068581 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-ebc85303-0218-4f98-a87b-d0888843def1 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:16.072868 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-ebc85303-0218-4f98-a87b-d0888843def1 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:16.245031 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ebc85303-0218-4f98-a87b-d0888843def1 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:16.262416 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-0f5c49b9-13ce-48a9-92ea-dca6690dd380 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-855624180", "imageRef": "af86cedd-e7d5-4a28-a810-f47830f4bffc", "flavorRef": "452", "networks": [{"uuid": "ff34e378-f58b-45e9-a487-b72107a8e88d"}]}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:11:16.269914 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-ebc85303-0218-4f98-a87b-d0888843def1 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1215 microversion: 2.1 time: 0.205207 Feb 09 13:11:16.285420 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 2/5] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:16 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1215 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:16.560702 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.network.neutron [None req-0f5c49b9-13ce-48a9-92ea-dca6690dd380 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] validate_networks() for [('ff34e378-f58b-45e9-a487-b72107a8e88d', None, None, None, None, None)] {{(pid=116749) validate_networks /opt/stack/nova/nova/network/neutron.py:2554}} Feb 09 13:11:16.926477 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-ae99b931-2a05-4742-8d42-d96d6930878a tempest-VolumesGetTestJSON-1368891026 tempest-VolumesGetTestJSON-1368891026-project] Calling method '.version_select at 0x7f7f65caa430>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:17.098855 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-ae99b931-2a05-4742-8d42-d96d6930878a tempest-VolumesGetTestJSON-1368891026 tempest-VolumesGetTestJSON-1368891026-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/717829f6-9c9d-4e01-b18b-c82aa146af93" status: 200 len: 354 microversion: 2.1 time: 0.180953 Feb 09 13:11:17.105050 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 3/6] 10.222.0.84 () {58 vars in 1244 bytes} [Wed Feb 9 13:11:16 2022] GET /compute/v2.1/os-volumes/717829f6-9c9d-4e01-b18b-c82aa146af93 => generated 354 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:11:17.110980 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-16692488-902c-4b26-9151-be74af0ec48f tempest-VolumesGetTestJSON-1368891026 tempest-VolumesGetTestJSON-1368891026-project] Calling method '.version_select at 0x7f7f65450820>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:17.275027 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-16692488-902c-4b26-9151-be74af0ec48f tempest-VolumesGetTestJSON-1368891026 tempest-VolumesGetTestJSON-1368891026-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/717829f6-9c9d-4e01-b18b-c82aa146af93" status: 200 len: 354 microversion: 2.1 time: 0.167441 Feb 09 13:11:17.275809 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 4/7] 10.222.0.84 () {58 vars in 1244 bytes} [Wed Feb 9 13:11:17 2022] GET /compute/v2.1/os-volumes/717829f6-9c9d-4e01-b18b-c82aa146af93 => generated 354 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:11:17.291221 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-b7e35970-7a73-47a7-aa61-c495caf110ef tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:17.291863 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-b7e35970-7a73-47a7-aa61-c495caf110ef tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:17.498706 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-b7e35970-7a73-47a7-aa61-c495caf110ef tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:17.514120 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-b7e35970-7a73-47a7-aa61-c495caf110ef tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1215 microversion: 2.1 time: 0.227338 Feb 09 13:11:17.526209 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 5/8] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:17 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1215 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:17.536388 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-0f7f563c-3e09-4538-8779-6dda4d878d15 tempest-VolumesGetTestJSON-1368891026 tempest-VolumesGetTestJSON-1368891026-project] Calling method '.version_select at 0x7f7f654353a0>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:18.181467 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-0f5c49b9-13ce-48a9-92ea-dca6690dd380 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Flavor limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 09 13:11:18.181467 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-0f5c49b9-13ce-48a9-92ea-dca6690dd380 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Image limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 09 13:11:18.181467 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-0f5c49b9-13ce-48a9-92ea-dca6690dd380 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Flavor pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 09 13:11:18.181467 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-0f5c49b9-13ce-48a9-92ea-dca6690dd380 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Image pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 09 13:11:18.181467 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-0f5c49b9-13ce-48a9-92ea-dca6690dd380 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 09 13:11:18.194863 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-0f7f563c-3e09-4538-8779-6dda4d878d15 tempest-VolumesGetTestJSON-1368891026 tempest-VolumesGetTestJSON-1368891026-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/717829f6-9c9d-4e01-b18b-c82aa146af93" status: 202 len: 0 microversion: 2.1 time: 0.402504 Feb 09 13:11:18.194863 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 6/9] 10.222.0.84 () {58 vars in 1247 bytes} [Wed Feb 9 13:11:17 2022] DELETE /compute/v2.1/os-volumes/717829f6-9c9d-4e01-b18b-c82aa146af93 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:11:18.194863 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-9e4b4bf5-257c-4717-b206-ceb5b1ad979a tempest-VolumesGetTestJSON-1368891026 tempest-VolumesGetTestJSON-1368891026-project] Calling method '.version_select at 0x7f7f65435c10>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:18.197015 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0f5c49b9-13ce-48a9-92ea-dca6690dd380 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:18.197015 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0f5c49b9-13ce-48a9-92ea-dca6690dd380 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:18.197015 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0f5c49b9-13ce-48a9-92ea-dca6690dd380 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:18.197015 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0f5c49b9-13ce-48a9-92ea-dca6690dd380 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:18.197484 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-0f5c49b9-13ce-48a9-92ea-dca6690dd380 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Getting quotas for project a0e498b288c5455ea4e270d16d92dc89. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:11:18.197484 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-0f5c49b9-13ce-48a9-92ea-dca6690dd380 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Getting quotas for user 39ee736e50d340be8da8586ee48fc7b5 and project a0e498b288c5455ea4e270d16d92dc89. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:11:18.197484 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-0f5c49b9-13ce-48a9-92ea-dca6690dd380 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Going to run 1 instances... {{(pid=116749) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 09 13:11:18.197484 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-0f5c49b9-13ce-48a9-92ea-dca6690dd380 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af86cedd-e7d5-4a28-a810-f47830f4bffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 09 13:11:18.197840 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-9e4b4bf5-257c-4717-b206-ceb5b1ad979a tempest-VolumesGetTestJSON-1368891026 tempest-VolumesGetTestJSON-1368891026-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/717829f6-9c9d-4e01-b18b-c82aa146af93" status: 200 len: 353 microversion: 2.1 time: 0.115018 Feb 09 13:11:18.197840 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 7/10] 10.222.0.84 () {58 vars in 1244 bytes} [Wed Feb 9 13:11:17 2022] GET /compute/v2.1/os-volumes/717829f6-9c9d-4e01-b18b-c82aa146af93 => generated 353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:11:18.315678 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-0f5c49b9-13ce-48a9-92ea-dca6690dd380 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.405316 Feb 09 13:11:18.317925 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 4/11] 10.222.0.84 () {60 vars in 1146 bytes} [Wed Feb 9 13:11:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 09 13:11:18.331788 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-1d413a5d-8e70-4db7-966c-830c2c167c6d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:18.332741 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-1d413a5d-8e70-4db7-966c-830c2c167c6d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:18.588082 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-3da37a39-70af-4924-991d-ae0b93ee3f53 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Action: 'create', calling method: .version_select at 0x7f7f665c6ee0>, body: {"keypair": {"name": "tempest-keypair-1046216498"}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:11:18.601875 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-1d413a5d-8e70-4db7-966c-830c2c167c6d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:18.638502 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-1d413a5d-8e70-4db7-966c-830c2c167c6d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1217 microversion: 2.1 time: 0.311558 Feb 09 13:11:18.641703 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 5/12] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:18 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1217 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:18.650854 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-67618de2-11a2-4fdd-97f4-11e19666c310 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:18.657241 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-67618de2-11a2-4fdd-97f4-11e19666c310 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:18.695716 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-3da37a39-70af-4924-991d-ae0b93ee3f53 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Getting quotas for project 413094dda74649c282bf36d27168fc96. Resources: {'key_pairs'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:11:18.703942 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-3da37a39-70af-4924-991d-ae0b93ee3f53 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Getting quotas for user 0cdb5b8deadf447da675e9a24395a82f and project 413094dda74649c282bf36d27168fc96. Resources: {'key_pairs'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:11:18.787696 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-67618de2-11a2-4fdd-97f4-11e19666c310 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:18.799900 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-67618de2-11a2-4fdd-97f4-11e19666c310 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1215 microversion: 2.1 time: 0.154173 Feb 09 13:11:18.811372 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 6/13] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:18 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:19.057235 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-3b5dd5ad-c6f9-4549-afb2-5bbdb2395551 tempest-VolumesGetTestJSON-1368891026 tempest-VolumesGetTestJSON-1368891026-project] Calling method '.version_select at 0x7f7f653c05e0>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:19.116608 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-3b5dd5ad-c6f9-4549-afb2-5bbdb2395551 tempest-VolumesGetTestJSON-1368891026 tempest-VolumesGetTestJSON-1368891026-project] HTTP exception thrown: Volume 717829f6-9c9d-4e01-b18b-c82aa146af93 could not be found. Feb 09 13:11:19.117246 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-3b5dd5ad-c6f9-4549-afb2-5bbdb2395551 tempest-VolumesGetTestJSON-1368891026 tempest-VolumesGetTestJSON-1368891026-project] Returning 404 to user: Volume 717829f6-9c9d-4e01-b18b-c82aa146af93 could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:11:19.118470 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-3b5dd5ad-c6f9-4549-afb2-5bbdb2395551 tempest-VolumesGetTestJSON-1368891026 tempest-VolumesGetTestJSON-1368891026-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/717829f6-9c9d-4e01-b18b-c82aa146af93" status: 404 len: 109 microversion: 2.1 time: 0.066325 Feb 09 13:11:19.119281 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 7/14] 10.222.0.84 () {58 vars in 1244 bytes} [Wed Feb 9 13:11:19 2022] GET /compute/v2.1/os-volumes/717829f6-9c9d-4e01-b18b-c82aa146af93 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 09 13:11:19.238730 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-3da37a39-70af-4924-991d-ae0b93ee3f53 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Getting quotas for project 413094dda74649c282bf36d27168fc96. Resources: {'key_pairs'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:11:19.244259 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-3da37a39-70af-4924-991d-ae0b93ee3f53 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Getting quotas for user 0cdb5b8deadf447da675e9a24395a82f and project 413094dda74649c282bf36d27168fc96. Resources: {'key_pairs'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:11:19.264543 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-3da37a39-70af-4924-991d-ae0b93ee3f53 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.020823 Feb 09 13:11:19.265211 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 8/15] 10.222.0.84 () {60 vars in 1157 bytes} [Wed Feb 9 13:11:18 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:19.661549 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-98fef03a-d0cb-48ce-9a2d-053e3eb3faf6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:19.661549 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-98fef03a-d0cb-48ce-9a2d-053e3eb3faf6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:19.802846 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-98fef03a-d0cb-48ce-9a2d-053e3eb3faf6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:19.816910 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-98fef03a-d0cb-48ce-9a2d-053e3eb3faf6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1217 microversion: 2.1 time: 0.161829 Feb 09 13:11:19.821584 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 8/16] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:19 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:19.833581 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-69c44d5a-5a8e-4f78-8146-6e5ffa762cb6 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:19.838811 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-69c44d5a-5a8e-4f78-8146-6e5ffa762cb6 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:19.882599 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-69c44d5a-5a8e-4f78-8146-6e5ffa762cb6 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:19.887622 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-69c44d5a-5a8e-4f78-8146-6e5ffa762cb6 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:19.895672 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-69c44d5a-5a8e-4f78-8146-6e5ffa762cb6 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:19.898890 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-69c44d5a-5a8e-4f78-8146-6e5ffa762cb6 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:20.265085 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-69c44d5a-5a8e-4f78-8146-6e5ffa762cb6 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:20.301799 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-69c44d5a-5a8e-4f78-8146-6e5ffa762cb6 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1211 microversion: 2.1 time: 0.488074 Feb 09 13:11:20.304434 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 9/17] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:19 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1211 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:20.837449 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d82ac9b3-d03f-4113-a117-bafccbb4b7e4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:20.837449 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d82ac9b3-d03f-4113-a117-bafccbb4b7e4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:20.853480 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d82ac9b3-d03f-4113-a117-bafccbb4b7e4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:20.855989 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d82ac9b3-d03f-4113-a117-bafccbb4b7e4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:20.859162 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d82ac9b3-d03f-4113-a117-bafccbb4b7e4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:20.860313 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d82ac9b3-d03f-4113-a117-bafccbb4b7e4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:21.328556 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-b9d7ef7c-ae97-4c50-964e-5669b83aeeed tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:21.329175 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-b9d7ef7c-ae97-4c50-964e-5669b83aeeed tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:21.340469 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b9d7ef7c-ae97-4c50-964e-5669b83aeeed tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:21.341270 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b9d7ef7c-ae97-4c50-964e-5669b83aeeed tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:21.365383 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b9d7ef7c-ae97-4c50-964e-5669b83aeeed tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:21.366737 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b9d7ef7c-ae97-4c50-964e-5669b83aeeed tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:21.652517 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-b9d7ef7c-ae97-4c50-964e-5669b83aeeed tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:21.666046 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-b9d7ef7c-ae97-4c50-964e-5669b83aeeed tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1275 microversion: 2.1 time: 0.341545 Feb 09 13:11:21.666917 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 10/18] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:21 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1275 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:21.719026 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-d82ac9b3-d03f-4113-a117-bafccbb4b7e4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:21.742403 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d82ac9b3-d03f-4113-a117-bafccbb4b7e4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1221 microversion: 2.1 time: 0.910729 Feb 09 13:11:21.756617 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 9/19] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:20 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1221 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:22.684365 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-72601e02-e037-4284-af3b-d156f4339838 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:22.686024 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-72601e02-e037-4284-af3b-d156f4339838 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:22.693229 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-72601e02-e037-4284-af3b-d156f4339838 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:22.693685 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-72601e02-e037-4284-af3b-d156f4339838 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:22.694473 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-72601e02-e037-4284-af3b-d156f4339838 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:22.707448 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-72601e02-e037-4284-af3b-d156f4339838 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:22.763598 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-6dfb17b2-3cc4-4b85-a678-7e5de2fd4fac tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:22.764297 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-6dfb17b2-3cc4-4b85-a678-7e5de2fd4fac tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:22.770195 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6dfb17b2-3cc4-4b85-a678-7e5de2fd4fac tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:22.770673 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6dfb17b2-3cc4-4b85-a678-7e5de2fd4fac tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:22.771490 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6dfb17b2-3cc4-4b85-a678-7e5de2fd4fac tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:22.771941 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6dfb17b2-3cc4-4b85-a678-7e5de2fd4fac tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:22.871474 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-72601e02-e037-4284-af3b-d156f4339838 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:22.880150 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-72601e02-e037-4284-af3b-d156f4339838 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1273 microversion: 2.1 time: 0.200212 Feb 09 13:11:22.888631 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 11/20] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:22 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1273 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:23.069846 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6dfb17b2-3cc4-4b85-a678-7e5de2fd4fac tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:23.082043 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-6dfb17b2-3cc4-4b85-a678-7e5de2fd4fac tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1277 microversion: 2.1 time: 0.320472 Feb 09 13:11:23.094900 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 10/21] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:22 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1277 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:23.911937 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-39f4d731-0560-4391-a055-668797e10a3c tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:23.912738 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-39f4d731-0560-4391-a055-668797e10a3c tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:23.921899 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-39f4d731-0560-4391-a055-668797e10a3c tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:23.928876 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-39f4d731-0560-4391-a055-668797e10a3c tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:23.930171 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-39f4d731-0560-4391-a055-668797e10a3c tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:23.931417 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-39f4d731-0560-4391-a055-668797e10a3c tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:24.100640 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-98f43fba-c578-4c5e-bdc9-f926bb1ceee4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:24.102027 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-98f43fba-c578-4c5e-bdc9-f926bb1ceee4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:24.112071 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-98f43fba-c578-4c5e-bdc9-f926bb1ceee4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:24.122265 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-98f43fba-c578-4c5e-bdc9-f926bb1ceee4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:24.123980 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-98f43fba-c578-4c5e-bdc9-f926bb1ceee4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:24.124650 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-98f43fba-c578-4c5e-bdc9-f926bb1ceee4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:24.219967 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-39f4d731-0560-4391-a055-668797e10a3c tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:24.237025 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-39f4d731-0560-4391-a055-668797e10a3c tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1273 microversion: 2.1 time: 0.328624 Feb 09 13:11:24.259169 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 12/22] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:23 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1273 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:24.644602 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-98f43fba-c578-4c5e-bdc9-f926bb1ceee4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:24.673951 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-98f43fba-c578-4c5e-bdc9-f926bb1ceee4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1275 microversion: 2.1 time: 0.577034 Feb 09 13:11:24.677110 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 11/23] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:24 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1275 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:25.274875 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-9a828320-fac6-4f43-af50-d30964f22447 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:25.275506 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-9a828320-fac6-4f43-af50-d30964f22447 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:25.298616 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9a828320-fac6-4f43-af50-d30964f22447 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:25.299122 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9a828320-fac6-4f43-af50-d30964f22447 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:25.299952 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9a828320-fac6-4f43-af50-d30964f22447 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:25.300391 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9a828320-fac6-4f43-af50-d30964f22447 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:25.693126 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-f0906a7f-dbb4-4794-8f70-8b48bc6ade41 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:25.694404 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-f0906a7f-dbb4-4794-8f70-8b48bc6ade41 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:25.708147 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f0906a7f-dbb4-4794-8f70-8b48bc6ade41 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:25.709905 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f0906a7f-dbb4-4794-8f70-8b48bc6ade41 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:25.712889 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f0906a7f-dbb4-4794-8f70-8b48bc6ade41 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:25.713509 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f0906a7f-dbb4-4794-8f70-8b48bc6ade41 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:25.757485 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-9a828320-fac6-4f43-af50-d30964f22447 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:25.806254 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-9a828320-fac6-4f43-af50-d30964f22447 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1315 microversion: 2.1 time: 0.524878 Feb 09 13:11:25.826823 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 13/24] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:25 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:26.247167 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-f0906a7f-dbb4-4794-8f70-8b48bc6ade41 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:26.267689 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-f0906a7f-dbb4-4794-8f70-8b48bc6ade41 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1275 microversion: 2.1 time: 0.578420 Feb 09 13:11:26.271678 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 12/25] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:25 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1275 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:26.844658 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-7869ea3f-2b82-42d8-9c86-0e78932c2b61 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:26.850975 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-7869ea3f-2b82-42d8-9c86-0e78932c2b61 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:26.861281 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7869ea3f-2b82-42d8-9c86-0e78932c2b61 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:26.861986 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7869ea3f-2b82-42d8-9c86-0e78932c2b61 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:26.863026 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7869ea3f-2b82-42d8-9c86-0e78932c2b61 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:26.865046 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7869ea3f-2b82-42d8-9c86-0e78932c2b61 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:27.291293 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-1ba7dad6-1330-462d-b6aa-ba55a64f29a0 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:27.292532 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-1ba7dad6-1330-462d-b6aa-ba55a64f29a0 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:27.308775 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1ba7dad6-1330-462d-b6aa-ba55a64f29a0 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:27.312512 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1ba7dad6-1330-462d-b6aa-ba55a64f29a0 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:27.313377 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1ba7dad6-1330-462d-b6aa-ba55a64f29a0 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:27.313828 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1ba7dad6-1330-462d-b6aa-ba55a64f29a0 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:27.526493 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-1ba7dad6-1330-462d-b6aa-ba55a64f29a0 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:27.543423 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-1ba7dad6-1330-462d-b6aa-ba55a64f29a0 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1275 microversion: 2.1 time: 0.257606 Feb 09 13:11:27.554200 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 13/26] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:27 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1275 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:27.633969 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-7869ea3f-2b82-42d8-9c86-0e78932c2b61 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:27.651334 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-7869ea3f-2b82-42d8-9c86-0e78932c2b61 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1315 microversion: 2.1 time: 0.808615 Feb 09 13:11:27.653078 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 14/27] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:26 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1315 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:28.568050 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-db5c932b-3a35-49c6-b682-39234888f07d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:28.569894 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-db5c932b-3a35-49c6-b682-39234888f07d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:28.583688 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-db5c932b-3a35-49c6-b682-39234888f07d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:28.595167 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-db5c932b-3a35-49c6-b682-39234888f07d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:28.595167 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-db5c932b-3a35-49c6-b682-39234888f07d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:28.595167 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-db5c932b-3a35-49c6-b682-39234888f07d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:29.014990 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-db5c932b-3a35-49c6-b682-39234888f07d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:29.024865 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-db5c932b-3a35-49c6-b682-39234888f07d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1317 microversion: 2.1 time: 0.461810 Feb 09 13:11:29.025458 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 15/28] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:28 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1317 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:29.033158 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-fd388787-5a6e-48a5-9035-e1f4b27c9f83 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:29.038808 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-fd388787-5a6e-48a5-9035-e1f4b27c9f83 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:29.055960 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fd388787-5a6e-48a5-9035-e1f4b27c9f83 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:29.056714 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fd388787-5a6e-48a5-9035-e1f4b27c9f83 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:29.059540 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fd388787-5a6e-48a5-9035-e1f4b27c9f83 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:29.062464 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fd388787-5a6e-48a5-9035-e1f4b27c9f83 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:29.611982 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-fd388787-5a6e-48a5-9035-e1f4b27c9f83 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:29.627325 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-fd388787-5a6e-48a5-9035-e1f4b27c9f83 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1315 microversion: 2.1 time: 0.597706 Feb 09 13:11:29.638209 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 16/29] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:29 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:29.645989 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-47260e54-c9e0-4d66-bb6a-0912dfd64a1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1016037892", "imageRef": "af86cedd-e7d5-4a28-a810-f47830f4bffc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ce67157-f48b-4d2d-b32c-6a12d5e26c1b"}], "security_groups": [{"name": "tempest-securitygroup--1517457601"}], "key_name": "tempest-keypair-1046216498", "user_data": "}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:11:29.838842 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8c006328-4132-48ac-a13e-64ea972a61a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1975252535", "imageRef": "af86cedd-e7d5-4a28-a810-f47830f4bffc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:11:29.880630 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.network.neutron [None req-47260e54-c9e0-4d66-bb6a-0912dfd64a1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] validate_networks() for [('9ce67157-f48b-4d2d-b32c-6a12d5e26c1b', None, None, None, None, None)] {{(pid=116748) validate_networks /opt/stack/nova/nova/network/neutron.py:2554}} Feb 09 13:11:29.925013 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.network.neutron [None req-8c006328-4132-48ac-a13e-64ea972a61a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] validate_networks() for [('356c94e6-31e4-4e9e-9f08-04565eefbcb7', None, None, None, None, None)] {{(pid=116749) validate_networks /opt/stack/nova/nova/network/neutron.py:2554}} Feb 09 13:11:30.855797 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-47260e54-c9e0-4d66-bb6a-0912dfd64a1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Flavor limits 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 09 13:11:30.856259 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-47260e54-c9e0-4d66-bb6a-0912dfd64a1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Image limits 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 09 13:11:30.856689 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-47260e54-c9e0-4d66-bb6a-0912dfd64a1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Flavor pref 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 09 13:11:30.857101 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-47260e54-c9e0-4d66-bb6a-0912dfd64a1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Image pref 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 09 13:11:30.857512 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-47260e54-c9e0-4d66-bb6a-0912dfd64a1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 09 13:11:30.866953 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-47260e54-c9e0-4d66-bb6a-0912dfd64a1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:30.867412 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-47260e54-c9e0-4d66-bb6a-0912dfd64a1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:30.868783 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-47260e54-c9e0-4d66-bb6a-0912dfd64a1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:30.869229 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-47260e54-c9e0-4d66-bb6a-0912dfd64a1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:30.896360 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-47260e54-c9e0-4d66-bb6a-0912dfd64a1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Getting quotas for project 413094dda74649c282bf36d27168fc96. Resources: {'instances', 'cores', 'ram'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:11:30.901185 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-47260e54-c9e0-4d66-bb6a-0912dfd64a1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Getting quotas for user 0cdb5b8deadf447da675e9a24395a82f and project 413094dda74649c282bf36d27168fc96. Resources: {'instances', 'cores', 'ram'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:11:30.915521 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-47260e54-c9e0-4d66-bb6a-0912dfd64a1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Going to run 1 instances... {{(pid=116748) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 09 13:11:30.918056 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-47260e54-c9e0-4d66-bb6a-0912dfd64a1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af86cedd-e7d5-4a28-a810-f47830f4bffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 09 13:11:31.000113 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-8c006328-4132-48ac-a13e-64ea972a61a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Flavor limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 09 13:11:31.005450 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-8c006328-4132-48ac-a13e-64ea972a61a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Image limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 09 13:11:31.005952 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-8c006328-4132-48ac-a13e-64ea972a61a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Flavor pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 09 13:11:31.006371 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-8c006328-4132-48ac-a13e-64ea972a61a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Image pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 09 13:11:31.006815 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-8c006328-4132-48ac-a13e-64ea972a61a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 09 13:11:31.015620 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8c006328-4132-48ac-a13e-64ea972a61a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:31.016045 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8c006328-4132-48ac-a13e-64ea972a61a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:31.017042 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8c006328-4132-48ac-a13e-64ea972a61a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:31.018025 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8c006328-4132-48ac-a13e-64ea972a61a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:31.038141 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-8c006328-4132-48ac-a13e-64ea972a61a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Getting quotas for project 141d2818a8454068b7397ceefa95ab7b. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:11:31.046491 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-8c006328-4132-48ac-a13e-64ea972a61a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Getting quotas for user f4c97ae472fe4b318dc9cd02cfee6b59 and project 141d2818a8454068b7397ceefa95ab7b. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:11:31.063154 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8c006328-4132-48ac-a13e-64ea972a61a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Going to run 1 instances... {{(pid=116749) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 09 13:11:31.066597 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8c006328-4132-48ac-a13e-64ea972a61a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af86cedd-e7d5-4a28-a810-f47830f4bffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 09 13:11:31.124478 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-47260e54-c9e0-4d66-bb6a-0912dfd64a1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.484406 Feb 09 13:11:31.125247 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 17/30] 10.222.0.84 () {60 vars in 1146 bytes} [Wed Feb 9 13:11:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 1486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 09 13:11:31.129918 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-836a64ae-2bfd-42dc-aa7f-90df0f4755ed tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:31.139096 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-836a64ae-2bfd-42dc-aa7f-90df0f4755ed tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:31.154531 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-836a64ae-2bfd-42dc-aa7f-90df0f4755ed tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:31.155493 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-836a64ae-2bfd-42dc-aa7f-90df0f4755ed tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:31.156592 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-836a64ae-2bfd-42dc-aa7f-90df0f4755ed tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:31.157205 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-836a64ae-2bfd-42dc-aa7f-90df0f4755ed tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:31.243200 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8c006328-4132-48ac-a13e-64ea972a61a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.896663 Feb 09 13:11:31.244203 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 14/31] 10.222.0.84 () {60 vars in 1146 bytes} [Wed Feb 9 13:11:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 2898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 09 13:11:31.353350 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-836a64ae-2bfd-42dc-aa7f-90df0f4755ed tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:31.363957 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-836a64ae-2bfd-42dc-aa7f-90df0f4755ed tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1317 microversion: 2.1 time: 0.237385 Feb 09 13:11:31.365531 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 18/32] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:31 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:31.370860 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-a20247e9-ec45-46eb-8471-d01d0785f69e tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:31.372254 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-a20247e9-ec45-46eb-8471-d01d0785f69e tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:31.380860 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a20247e9-ec45-46eb-8471-d01d0785f69e tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:31.381653 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a20247e9-ec45-46eb-8471-d01d0785f69e tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:31.382720 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a20247e9-ec45-46eb-8471-d01d0785f69e tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:31.384033 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a20247e9-ec45-46eb-8471-d01d0785f69e tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:31.445683 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-bb886992-5548-4f3c-81af-0ca4585d54ae req-ac5637c1-6ed6-4970-94cd-3961511d8c7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3449e9bb-2fd1-40a5-8003-d773c6d60736", "tag": "65961941-2a92-4fd6-a368-cadf07ece780"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:11:31.449392 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:11:31.449392 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:11:31.464465 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-bb886992-5548-4f3c-81af-0ca4585d54ae req-ac5637c1-6ed6-4970-94cd-3961511d8c7e service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:31.465502 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-bb886992-5548-4f3c-81af-0ca4585d54ae req-ac5637c1-6ed6-4970-94cd-3961511d8c7e service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:31.498323 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-bb886992-5548-4f3c-81af-0ca4585d54ae req-ac5637c1-6ed6-4970-94cd-3961511d8c7e service nova] Creating event network-changed:65961941-2a92-4fd6-a368-cadf07ece780 for instance 3449e9bb-2fd1-40a5-8003-d773c6d60736 on hv-cinder-82786 Feb 09 13:11:31.502692 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-bb886992-5548-4f3c-81af-0ca4585d54ae req-ac5637c1-6ed6-4970-94cd-3961511d8c7e service nova] Acquired lock "compute-rpcapi-router" {{(pid=116749) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 09 13:11:31.512101 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9081f12f-7619-4342-b313-aacc0f429ef0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:31.512834 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9081f12f-7619-4342-b313-aacc0f429ef0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:31.514107 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9081f12f-7619-4342-b313-aacc0f429ef0 None None] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:31.515028 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9081f12f-7619-4342-b313-aacc0f429ef0 None None] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:31.537523 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.compute.rpcapi [None req-9081f12f-7619-4342-b313-aacc0f429ef0 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Feb 09 13:11:31.543473 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9081f12f-7619-4342-b313-aacc0f429ef0 None None] Releasing lock "compute-rpcapi-router" {{(pid=116749) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 09 13:11:31.592149 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-9081f12f-7619-4342-b313-aacc0f429ef0 None None] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.346686 Feb 09 13:11:31.592798 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 15/33] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:11:31.686222 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a20247e9-ec45-46eb-8471-d01d0785f69e tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:31.693935 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-a20247e9-ec45-46eb-8471-d01d0785f69e tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1315 microversion: 2.1 time: 0.326987 Feb 09 13:11:31.695933 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 19/34] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:31 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:31.700836 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-1fd0a862-44af-4a77-9941-d6b82e4d431c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:31.701722 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-1fd0a862-44af-4a77-9941-d6b82e4d431c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:31.782894 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-1fd0a862-44af-4a77-9941-d6b82e4d431c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:31.790518 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-1fd0a862-44af-4a77-9941-d6b82e4d431c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1238 microversion: 2.1 time: 0.092678 Feb 09 13:11:31.791140 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 20/35] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:31 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1238 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:31.795616 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-cf214583-7783-4564-a9c0-3eec8c3f7cc1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:31.796487 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-cf214583-7783-4564-a9c0-3eec8c3f7cc1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:31.805902 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-1111df7a-febc-4b85-8be4-fcf10fae2e77 req-fc5f7d96-b8bf-44e5-b5d3-abb390443592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "894904de-6d54-4785-b905-4a1901d9d87f", "tag": "0c7a08f1-289e-49bd-b9bc-e830edeaee6f"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:11:31.810476 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:11:31.810476 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:11:31.823467 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-1111df7a-febc-4b85-8be4-fcf10fae2e77 req-fc5f7d96-b8bf-44e5-b5d3-abb390443592 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:31.824199 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-1111df7a-febc-4b85-8be4-fcf10fae2e77 req-fc5f7d96-b8bf-44e5-b5d3-abb390443592 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:31.835328 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-1111df7a-febc-4b85-8be4-fcf10fae2e77 req-fc5f7d96-b8bf-44e5-b5d3-abb390443592 service nova] Creating event network-changed:0c7a08f1-289e-49bd-b9bc-e830edeaee6f for instance 894904de-6d54-4785-b905-4a1901d9d87f on hv-cinder-82786 Feb 09 13:11:31.843554 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-1111df7a-febc-4b85-8be4-fcf10fae2e77 req-fc5f7d96-b8bf-44e5-b5d3-abb390443592 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.248835 Feb 09 13:11:31.844194 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 16/36] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:11:31.868622 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-cf214583-7783-4564-a9c0-3eec8c3f7cc1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:31.876513 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-cf214583-7783-4564-a9c0-3eec8c3f7cc1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1222 microversion: 2.1 time: 0.084015 Feb 09 13:11:31.877485 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 21/37] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:31 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:32.014602 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-54af5723-98de-4830-a042-31844ed1476a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1099357666", "imageRef": "af86cedd-e7d5-4a28-a810-f47830f4bffc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:11:32.079932 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.network.neutron [None req-54af5723-98de-4830-a042-31844ed1476a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] validate_networks() for [('356c94e6-31e4-4e9e-9f08-04565eefbcb7', None, None, None, None, None)] {{(pid=116749) validate_networks /opt/stack/nova/nova/network/neutron.py:2554}} Feb 09 13:11:32.380984 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-6700be1c-487f-453d-84dc-8710a0635d1d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:32.382182 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-6700be1c-487f-453d-84dc-8710a0635d1d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:32.393831 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6700be1c-487f-453d-84dc-8710a0635d1d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:32.394469 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6700be1c-487f-453d-84dc-8710a0635d1d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:32.396241 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6700be1c-487f-453d-84dc-8710a0635d1d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:32.396691 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6700be1c-487f-453d-84dc-8710a0635d1d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:32.601692 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6700be1c-487f-453d-84dc-8710a0635d1d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:32.609826 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-6700be1c-487f-453d-84dc-8710a0635d1d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1317 microversion: 2.1 time: 0.232370 Feb 09 13:11:32.610698 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 22/38] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:32 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:32.622587 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-54af5723-98de-4830-a042-31844ed1476a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Flavor limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 09 13:11:32.623435 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-54af5723-98de-4830-a042-31844ed1476a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Image limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 09 13:11:32.623881 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-54af5723-98de-4830-a042-31844ed1476a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Flavor pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 09 13:11:32.624298 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-54af5723-98de-4830-a042-31844ed1476a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Image pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 09 13:11:32.624782 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-54af5723-98de-4830-a042-31844ed1476a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 09 13:11:32.639011 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-54af5723-98de-4830-a042-31844ed1476a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:32.639710 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-54af5723-98de-4830-a042-31844ed1476a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:32.640439 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-54af5723-98de-4830-a042-31844ed1476a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:32.643223 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-54af5723-98de-4830-a042-31844ed1476a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:32.686430 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-54af5723-98de-4830-a042-31844ed1476a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Getting quotas for project 141d2818a8454068b7397ceefa95ab7b. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:11:32.691629 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-54af5723-98de-4830-a042-31844ed1476a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Getting quotas for user f4c97ae472fe4b318dc9cd02cfee6b59 and project 141d2818a8454068b7397ceefa95ab7b. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:11:32.710808 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-54af5723-98de-4830-a042-31844ed1476a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Going to run 1 instances... {{(pid=116749) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 09 13:11:32.713690 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-54af5723-98de-4830-a042-31844ed1476a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af86cedd-e7d5-4a28-a810-f47830f4bffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 09 13:11:32.719370 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-4be0285c-efd5-4a08-aa53-2d60b51678ff tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:32.720701 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-4be0285c-efd5-4a08-aa53-2d60b51678ff tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:32.733801 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4be0285c-efd5-4a08-aa53-2d60b51678ff tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:32.734421 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4be0285c-efd5-4a08-aa53-2d60b51678ff tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:32.736130 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4be0285c-efd5-4a08-aa53-2d60b51678ff tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:32.736693 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4be0285c-efd5-4a08-aa53-2d60b51678ff tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:32.945445 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-4be0285c-efd5-4a08-aa53-2d60b51678ff tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:32.955359 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-4be0285c-efd5-4a08-aa53-2d60b51678ff tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1315 microversion: 2.1 time: 0.247429 Feb 09 13:11:32.956662 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 23/39] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:32 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:32.969757 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-0887820c-9e72-47d9-aba0-5bb2094561a0 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:32.970433 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-0887820c-9e72-47d9-aba0-5bb2094561a0 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:32.979622 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-54af5723-98de-4830-a042-31844ed1476a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.969578 Feb 09 13:11:32.983233 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0887820c-9e72-47d9-aba0-5bb2094561a0 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:32.983935 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0887820c-9e72-47d9-aba0-5bb2094561a0 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:32.985104 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0887820c-9e72-47d9-aba0-5bb2094561a0 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:32.985683 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0887820c-9e72-47d9-aba0-5bb2094561a0 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:32.986083 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 17/40] 10.222.0.84 () {60 vars in 1146 bytes} [Wed Feb 9 13:11:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 09 13:11:32.998120 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-9efb8af3-bbb1-4515-be80-c8821e558d93 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:32.999108 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-9efb8af3-bbb1-4515-be80-c8821e558d93 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:33.117114 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-0887820c-9e72-47d9-aba0-5bb2094561a0 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:33.130261 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-0887820c-9e72-47d9-aba0-5bb2094561a0 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1242 microversion: 2.1 time: 0.170891 Feb 09 13:11:33.131042 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 24/41] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:32 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1242 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:33.153136 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-9efb8af3-bbb1-4515-be80-c8821e558d93 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:33.159921 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-9efb8af3-bbb1-4515-be80-c8821e558d93 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1222 microversion: 2.1 time: 0.172359 Feb 09 13:11:33.160682 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 18/42] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:32 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1222 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:33.627351 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-3d963c77-bd0c-49c6-91c2-7d8287eeeb93 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:33.627961 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-3d963c77-bd0c-49c6-91c2-7d8287eeeb93 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:33.636295 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3d963c77-bd0c-49c6-91c2-7d8287eeeb93 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:33.636745 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3d963c77-bd0c-49c6-91c2-7d8287eeeb93 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:33.637765 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3d963c77-bd0c-49c6-91c2-7d8287eeeb93 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:33.638345 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3d963c77-bd0c-49c6-91c2-7d8287eeeb93 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:33.890206 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-3d963c77-bd0c-49c6-91c2-7d8287eeeb93 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:33.901161 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-3d963c77-bd0c-49c6-91c2-7d8287eeeb93 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1317 microversion: 2.1 time: 0.277050 Feb 09 13:11:33.903434 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 25/43] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:33 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:33.973120 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c6193070-6bb3-4c35-9836-19e9d467d4e1 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:33.973768 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-c6193070-6bb3-4c35-9836-19e9d467d4e1 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:33.982536 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c6193070-6bb3-4c35-9836-19e9d467d4e1 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:33.982936 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c6193070-6bb3-4c35-9836-19e9d467d4e1 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:33.986814 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c6193070-6bb3-4c35-9836-19e9d467d4e1 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:33.987308 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c6193070-6bb3-4c35-9836-19e9d467d4e1 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:34.147528 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-af422529-e5a0-4ada-a23f-59aafb6a6348 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:34.149764 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-af422529-e5a0-4ada-a23f-59aafb6a6348 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:34.184471 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-af422529-e5a0-4ada-a23f-59aafb6a6348 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:34.190192 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-af422529-e5a0-4ada-a23f-59aafb6a6348 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:34.192409 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-af422529-e5a0-4ada-a23f-59aafb6a6348 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:34.193626 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-af422529-e5a0-4ada-a23f-59aafb6a6348 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:34.371232 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-af422529-e5a0-4ada-a23f-59aafb6a6348 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:34.387786 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-af422529-e5a0-4ada-a23f-59aafb6a6348 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1242 microversion: 2.1 time: 0.243940 Feb 09 13:11:34.399888 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 26/44] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:34 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1242 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:34.403273 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-e26cc7eb-7792-4f62-a995-ef7f65fbb655 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:34.403890 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-e26cc7eb-7792-4f62-a995-ef7f65fbb655 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:34.597413 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e26cc7eb-7792-4f62-a995-ef7f65fbb655 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:34.604679 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-e26cc7eb-7792-4f62-a995-ef7f65fbb655 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1222 microversion: 2.1 time: 0.204906 Feb 09 13:11:34.611998 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 27/45] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:34 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1222 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:34.922446 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-4ab2b84a-0911-4338-a122-32550d6c2a8f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:34.923563 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-4ab2b84a-0911-4338-a122-32550d6c2a8f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:34.935301 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4ab2b84a-0911-4338-a122-32550d6c2a8f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:34.938689 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4ab2b84a-0911-4338-a122-32550d6c2a8f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:34.941643 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4ab2b84a-0911-4338-a122-32550d6c2a8f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:34.942282 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4ab2b84a-0911-4338-a122-32550d6c2a8f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:34.955853 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c6193070-6bb3-4c35-9836-19e9d467d4e1 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:34.965706 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c6193070-6bb3-4c35-9836-19e9d467d4e1 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1315 microversion: 2.1 time: 0.995857 Feb 09 13:11:34.982642 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 19/46] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:33 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1315 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:35.407345 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-1378a917-331c-48fa-8c55-d6bd180740eb tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:35.408753 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-1378a917-331c-48fa-8c55-d6bd180740eb tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:35.463034 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1378a917-331c-48fa-8c55-d6bd180740eb tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:35.467184 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1378a917-331c-48fa-8c55-d6bd180740eb tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:35.467184 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1378a917-331c-48fa-8c55-d6bd180740eb tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:35.467184 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1378a917-331c-48fa-8c55-d6bd180740eb tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:35.620168 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-1378a917-331c-48fa-8c55-d6bd180740eb tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:35.632682 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-1378a917-331c-48fa-8c55-d6bd180740eb tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1290 microversion: 2.1 time: 0.231502 Feb 09 13:11:35.640285 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 20/47] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:35 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1290 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:35.655800 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ec08e8ac-24ce-41a0-833c-461f1cf09a6d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:35.657817 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-ec08e8ac-24ce-41a0-833c-461f1cf09a6d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:35.675273 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ec08e8ac-24ce-41a0-833c-461f1cf09a6d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:35.676127 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ec08e8ac-24ce-41a0-833c-461f1cf09a6d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:35.677285 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ec08e8ac-24ce-41a0-833c-461f1cf09a6d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:35.678023 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ec08e8ac-24ce-41a0-833c-461f1cf09a6d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:35.762716 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-4ab2b84a-0911-4338-a122-32550d6c2a8f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:35.775218 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-4ab2b84a-0911-4338-a122-32550d6c2a8f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1317 microversion: 2.1 time: 0.857497 Feb 09 13:11:35.785829 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 28/48] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:34 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1317 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:35.903384 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ec08e8ac-24ce-41a0-833c-461f1cf09a6d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:35.921884 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-ec08e8ac-24ce-41a0-833c-461f1cf09a6d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1226 microversion: 2.1 time: 0.280157 Feb 09 13:11:35.922722 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 21/49] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:35 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1226 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:35.996354 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-71ac3fed-3c64-485f-93e5-6c617f8e9135 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:35.997268 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-71ac3fed-3c64-485f-93e5-6c617f8e9135 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:36.008129 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-71ac3fed-3c64-485f-93e5-6c617f8e9135 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:36.009031 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-71ac3fed-3c64-485f-93e5-6c617f8e9135 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:36.009355 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-71ac3fed-3c64-485f-93e5-6c617f8e9135 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:36.009807 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-71ac3fed-3c64-485f-93e5-6c617f8e9135 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:36.261603 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-71ac3fed-3c64-485f-93e5-6c617f8e9135 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:36.287004 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-71ac3fed-3c64-485f-93e5-6c617f8e9135 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1315 microversion: 2.1 time: 0.287854 Feb 09 13:11:36.287004 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 29/50] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:35 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:36.652122 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-4c9502f3-8e47-4960-862d-ef06f708eb7b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:36.652882 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-4c9502f3-8e47-4960-862d-ef06f708eb7b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:36.659097 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4c9502f3-8e47-4960-862d-ef06f708eb7b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:36.659692 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4c9502f3-8e47-4960-862d-ef06f708eb7b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:36.660544 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4c9502f3-8e47-4960-862d-ef06f708eb7b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:36.661002 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4c9502f3-8e47-4960-862d-ef06f708eb7b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:36.730830 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-4c9502f3-8e47-4960-862d-ef06f708eb7b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:36.746888 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-4c9502f3-8e47-4960-862d-ef06f708eb7b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1290 microversion: 2.1 time: 0.100064 Feb 09 13:11:36.756129 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 22/51] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:36 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1290 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:36.794076 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-44d5af93-a8c9-4700-a821-6505447f2fce tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:36.794766 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-44d5af93-a8c9-4700-a821-6505447f2fce tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:36.801085 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-44d5af93-a8c9-4700-a821-6505447f2fce tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:36.801570 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-44d5af93-a8c9-4700-a821-6505447f2fce tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:36.802363 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-44d5af93-a8c9-4700-a821-6505447f2fce tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:36.802829 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-44d5af93-a8c9-4700-a821-6505447f2fce tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:36.940135 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-e1d52e16-ce20-4ccb-9910-568316947419 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:36.941026 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-e1d52e16-ce20-4ccb-9910-568316947419 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:36.947787 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e1d52e16-ce20-4ccb-9910-568316947419 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:36.948641 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e1d52e16-ce20-4ccb-9910-568316947419 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:36.949986 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e1d52e16-ce20-4ccb-9910-568316947419 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:36.950652 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e1d52e16-ce20-4ccb-9910-568316947419 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:37.085742 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-44d5af93-a8c9-4700-a821-6505447f2fce tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:37.086192 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-e1d52e16-ce20-4ccb-9910-568316947419 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:37.093824 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-44d5af93-a8c9-4700-a821-6505447f2fce tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1317 microversion: 2.1 time: 0.305319 Feb 09 13:11:37.094851 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 30/52] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:36 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:37.096748 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-e1d52e16-ce20-4ccb-9910-568316947419 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1274 microversion: 2.1 time: 0.160232 Feb 09 13:11:37.097556 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 23/53] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:36 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1274 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:37.300540 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d3b83af0-712b-42b3-840b-41f0611983aa tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:37.301381 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d3b83af0-712b-42b3-840b-41f0611983aa tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:37.310666 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d3b83af0-712b-42b3-840b-41f0611983aa tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:37.312076 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d3b83af0-712b-42b3-840b-41f0611983aa tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:37.312917 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d3b83af0-712b-42b3-840b-41f0611983aa tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:37.313369 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d3b83af0-712b-42b3-840b-41f0611983aa tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:37.703266 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d3b83af0-712b-42b3-840b-41f0611983aa tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:37.711028 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d3b83af0-712b-42b3-840b-41f0611983aa tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1315 microversion: 2.1 time: 0.414726 Feb 09 13:11:37.712005 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 31/54] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:37 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:37.764473 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-085386ef-9d54-470c-936c-590a25a9c6fa tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:37.765878 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-085386ef-9d54-470c-936c-590a25a9c6fa tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:37.774528 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-085386ef-9d54-470c-936c-590a25a9c6fa tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:37.775018 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-085386ef-9d54-470c-936c-590a25a9c6fa tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:37.776006 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-085386ef-9d54-470c-936c-590a25a9c6fa tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:37.776448 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-085386ef-9d54-470c-936c-590a25a9c6fa tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:37.846044 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-085386ef-9d54-470c-936c-590a25a9c6fa tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:37.853399 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-085386ef-9d54-470c-936c-590a25a9c6fa tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1308 microversion: 2.1 time: 0.092817 Feb 09 13:11:37.853975 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 24/55] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:37 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:38.112607 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-c9ba577e-c2ee-44d7-87a9-0c52cfe7c3b2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:38.113224 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-c9ba577e-c2ee-44d7-87a9-0c52cfe7c3b2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:38.120434 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c9ba577e-c2ee-44d7-87a9-0c52cfe7c3b2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:38.120849 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c9ba577e-c2ee-44d7-87a9-0c52cfe7c3b2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:38.122084 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c9ba577e-c2ee-44d7-87a9-0c52cfe7c3b2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:38.122464 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c9ba577e-c2ee-44d7-87a9-0c52cfe7c3b2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:38.124740 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-6159a26d-9b31-48ea-907d-c4536efdceff tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:38.125359 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-6159a26d-9b31-48ea-907d-c4536efdceff tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:38.131818 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6159a26d-9b31-48ea-907d-c4536efdceff tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:38.132473 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6159a26d-9b31-48ea-907d-c4536efdceff tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:38.133333 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6159a26d-9b31-48ea-907d-c4536efdceff tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:38.133846 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6159a26d-9b31-48ea-907d-c4536efdceff tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:38.210531 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6159a26d-9b31-48ea-907d-c4536efdceff tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:38.218180 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-6159a26d-9b31-48ea-907d-c4536efdceff tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1282 microversion: 2.1 time: 0.096962 Feb 09 13:11:38.222477 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 25/56] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:38 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1282 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:38.287486 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-c9ba577e-c2ee-44d7-87a9-0c52cfe7c3b2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:38.299433 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-c9ba577e-c2ee-44d7-87a9-0c52cfe7c3b2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1317 microversion: 2.1 time: 0.189749 Feb 09 13:11:38.299433 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 32/57] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:38 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:38.728367 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-5e8524fb-8eb6-415a-803d-f53c66930aa5 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:38.729009 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-5e8524fb-8eb6-415a-803d-f53c66930aa5 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:38.735103 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5e8524fb-8eb6-415a-803d-f53c66930aa5 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:38.735564 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5e8524fb-8eb6-415a-803d-f53c66930aa5 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:38.736360 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5e8524fb-8eb6-415a-803d-f53c66930aa5 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:38.737252 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5e8524fb-8eb6-415a-803d-f53c66930aa5 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:38.874523 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-38ed8de3-ad38-4578-a06a-f34bd31bcb44 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:38.875458 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-38ed8de3-ad38-4578-a06a-f34bd31bcb44 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:38.881687 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-38ed8de3-ad38-4578-a06a-f34bd31bcb44 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:38.883054 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-38ed8de3-ad38-4578-a06a-f34bd31bcb44 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:38.884571 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-38ed8de3-ad38-4578-a06a-f34bd31bcb44 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:38.885181 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-38ed8de3-ad38-4578-a06a-f34bd31bcb44 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:38.892887 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-5e8524fb-8eb6-415a-803d-f53c66930aa5 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:38.901347 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-5e8524fb-8eb6-415a-803d-f53c66930aa5 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1315 microversion: 2.1 time: 0.177212 Feb 09 13:11:38.901930 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 26/58] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:38 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:38.947972 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-38ed8de3-ad38-4578-a06a-f34bd31bcb44 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:38.955142 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-38ed8de3-ad38-4578-a06a-f34bd31bcb44 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1308 microversion: 2.1 time: 0.084277 Feb 09 13:11:38.955708 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 33/59] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:38 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1308 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:39.235564 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8b99fc04-18d1-49cc-a0e7-ef2765bd3639 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:39.236187 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8b99fc04-18d1-49cc-a0e7-ef2765bd3639 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:39.241871 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8b99fc04-18d1-49cc-a0e7-ef2765bd3639 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:39.242333 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8b99fc04-18d1-49cc-a0e7-ef2765bd3639 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:39.243656 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8b99fc04-18d1-49cc-a0e7-ef2765bd3639 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:39.244102 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8b99fc04-18d1-49cc-a0e7-ef2765bd3639 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:39.306873 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8b99fc04-18d1-49cc-a0e7-ef2765bd3639 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:39.315158 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8b99fc04-18d1-49cc-a0e7-ef2765bd3639 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1282 microversion: 2.1 time: 0.083052 Feb 09 13:11:39.315632 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-6cab3be9-d2b4-4f3b-8579-ae2465730508 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:39.316274 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 27/60] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:39 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1282 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:39.316430 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-6cab3be9-d2b4-4f3b-8579-ae2465730508 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:39.323404 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6cab3be9-d2b4-4f3b-8579-ae2465730508 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:39.324185 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6cab3be9-d2b4-4f3b-8579-ae2465730508 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:39.325460 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6cab3be9-d2b4-4f3b-8579-ae2465730508 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:39.326671 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6cab3be9-d2b4-4f3b-8579-ae2465730508 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:39.500629 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6cab3be9-d2b4-4f3b-8579-ae2465730508 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:39.507898 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-6cab3be9-d2b4-4f3b-8579-ae2465730508 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1317 microversion: 2.1 time: 0.196223 Feb 09 13:11:39.509065 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 34/61] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:39 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:39.917637 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d4d4be67-ff90-4b87-9533-a1a5e2927d47 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:39.918245 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d4d4be67-ff90-4b87-9533-a1a5e2927d47 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:39.924257 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d4d4be67-ff90-4b87-9533-a1a5e2927d47 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:39.924753 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d4d4be67-ff90-4b87-9533-a1a5e2927d47 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:39.925601 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d4d4be67-ff90-4b87-9533-a1a5e2927d47 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:39.926041 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d4d4be67-ff90-4b87-9533-a1a5e2927d47 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:39.971618 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-7e4ba051-1c1c-4c3c-a6bd-dbb9d1b0856a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:39.972246 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-7e4ba051-1c1c-4c3c-a6bd-dbb9d1b0856a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:39.979559 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7e4ba051-1c1c-4c3c-a6bd-dbb9d1b0856a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:39.980249 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7e4ba051-1c1c-4c3c-a6bd-dbb9d1b0856a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:39.981039 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7e4ba051-1c1c-4c3c-a6bd-dbb9d1b0856a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:39.981476 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7e4ba051-1c1c-4c3c-a6bd-dbb9d1b0856a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:40.043339 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-7e4ba051-1c1c-4c3c-a6bd-dbb9d1b0856a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:40.052912 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-7e4ba051-1c1c-4c3c-a6bd-dbb9d1b0856a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1308 microversion: 2.1 time: 0.085060 Feb 09 13:11:40.053487 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 35/62] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:39 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1308 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:40.076799 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-d4d4be67-ff90-4b87-9533-a1a5e2927d47 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:40.085534 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d4d4be67-ff90-4b87-9533-a1a5e2927d47 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1315 microversion: 2.1 time: 0.171680 Feb 09 13:11:40.086218 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 28/63] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:39 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:40.333786 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-adcd3237-d615-4ec9-9a05-d567c046843f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:40.336924 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-adcd3237-d615-4ec9-9a05-d567c046843f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:40.344598 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-adcd3237-d615-4ec9-9a05-d567c046843f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:40.346056 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-adcd3237-d615-4ec9-9a05-d567c046843f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:40.347030 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-adcd3237-d615-4ec9-9a05-d567c046843f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:40.347570 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-adcd3237-d615-4ec9-9a05-d567c046843f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:40.481379 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-adcd3237-d615-4ec9-9a05-d567c046843f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:40.490140 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-adcd3237-d615-4ec9-9a05-d567c046843f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1282 microversion: 2.1 time: 0.160479 Feb 09 13:11:40.490755 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 36/64] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:40 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1282 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:40.526959 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-dadb6515-926f-4db0-b4ae-0b5f80d127e7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:40.527784 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-dadb6515-926f-4db0-b4ae-0b5f80d127e7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:40.536612 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-dadb6515-926f-4db0-b4ae-0b5f80d127e7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:40.536612 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-dadb6515-926f-4db0-b4ae-0b5f80d127e7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:40.536612 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-dadb6515-926f-4db0-b4ae-0b5f80d127e7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:40.546715 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-dadb6515-926f-4db0-b4ae-0b5f80d127e7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:40.886657 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-dadb6515-926f-4db0-b4ae-0b5f80d127e7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:40.895702 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-dadb6515-926f-4db0-b4ae-0b5f80d127e7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1317 microversion: 2.1 time: 0.373708 Feb 09 13:11:40.902671 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 29/65] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:40 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:41.071377 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-feb0eb41-4751-4b54-8271-5f0e05d29517 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:41.072144 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-feb0eb41-4751-4b54-8271-5f0e05d29517 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:41.078059 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-feb0eb41-4751-4b54-8271-5f0e05d29517 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:41.078524 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-feb0eb41-4751-4b54-8271-5f0e05d29517 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:41.079419 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-feb0eb41-4751-4b54-8271-5f0e05d29517 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:41.079821 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-feb0eb41-4751-4b54-8271-5f0e05d29517 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:41.103380 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-bbffe509-e717-44ac-894e-913560331f6b tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:41.104146 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-bbffe509-e717-44ac-894e-913560331f6b tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:41.110340 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bbffe509-e717-44ac-894e-913560331f6b tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:41.110935 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bbffe509-e717-44ac-894e-913560331f6b tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:41.111944 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bbffe509-e717-44ac-894e-913560331f6b tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:41.112479 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bbffe509-e717-44ac-894e-913560331f6b tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:41.360718 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-feb0eb41-4751-4b54-8271-5f0e05d29517 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:41.369887 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-feb0eb41-4751-4b54-8271-5f0e05d29517 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1364 microversion: 2.1 time: 0.302340 Feb 09 13:11:41.371126 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 37/66] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:41 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1364 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:41.494869 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-bbffe509-e717-44ac-894e-913560331f6b tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:41.507441 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-ea9d4964-1693-4bb5-b8a4-1d6551d14056 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:41.508328 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-ea9d4964-1693-4bb5-b8a4-1d6551d14056 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:41.524916 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ea9d4964-1693-4bb5-b8a4-1d6551d14056 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:41.526339 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-bbffe509-e717-44ac-894e-913560331f6b tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1315 microversion: 2.1 time: 0.427404 Feb 09 13:11:41.528308 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ea9d4964-1693-4bb5-b8a4-1d6551d14056 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:41.528600 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 30/67] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:41 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:41.529599 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ea9d4964-1693-4bb5-b8a4-1d6551d14056 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:41.530280 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ea9d4964-1693-4bb5-b8a4-1d6551d14056 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:41.783192 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-003c48f1-9885-4bae-9f74-455483921fd4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-380408395", "imageRef": "af86cedd-e7d5-4a28-a810-f47830f4bffc", "flavorRef": "452", "networks": [{"uuid": "c14db480-376e-432e-bb98-3ed4db923bdb"}]}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:11:41.869704 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.network.neutron [None req-003c48f1-9885-4bae-9f74-455483921fd4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] validate_networks() for [('c14db480-376e-432e-bb98-3ed4db923bdb', None, None, None, None, None)] {{(pid=116749) validate_networks /opt/stack/nova/nova/network/neutron.py:2554}} Feb 09 13:11:42.267661 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ea9d4964-1693-4bb5-b8a4-1d6551d14056 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:42.282832 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-ea9d4964-1693-4bb5-b8a4-1d6551d14056 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1322 microversion: 2.1 time: 0.779948 Feb 09 13:11:42.285911 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 38/68] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:41 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1322 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:42.300993 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-14e89209-4fcc-4bfa-9625-030ca3e6abb2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:42.301662 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-14e89209-4fcc-4bfa-9625-030ca3e6abb2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:42.308898 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-14e89209-4fcc-4bfa-9625-030ca3e6abb2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:42.309342 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-14e89209-4fcc-4bfa-9625-030ca3e6abb2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:42.310464 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-14e89209-4fcc-4bfa-9625-030ca3e6abb2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:42.311220 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-14e89209-4fcc-4bfa-9625-030ca3e6abb2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:42.528698 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-14e89209-4fcc-4bfa-9625-030ca3e6abb2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:42.536461 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-14e89209-4fcc-4bfa-9625-030ca3e6abb2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1317 microversion: 2.1 time: 0.248300 Feb 09 13:11:42.537426 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 39/69] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:42 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:42.542766 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-6a3d461d-6402-47a9-bca1-2ad6aa2bbf53 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:42.543546 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-6a3d461d-6402-47a9-bca1-2ad6aa2bbf53 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:42.549874 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6a3d461d-6402-47a9-bca1-2ad6aa2bbf53 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:42.551055 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6a3d461d-6402-47a9-bca1-2ad6aa2bbf53 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:42.552005 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6a3d461d-6402-47a9-bca1-2ad6aa2bbf53 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:42.552587 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6a3d461d-6402-47a9-bca1-2ad6aa2bbf53 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:42.876815 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6a3d461d-6402-47a9-bca1-2ad6aa2bbf53 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:42.885063 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-6a3d461d-6402-47a9-bca1-2ad6aa2bbf53 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1364 microversion: 2.1 time: 0.346410 Feb 09 13:11:42.885653 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 40/70] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:42 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1364 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:42.898271 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-df27c411-48a3-4d6e-91c9-0c69216a6f52 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:42.902102 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-df27c411-48a3-4d6e-91c9-0c69216a6f52 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:42.918347 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-df27c411-48a3-4d6e-91c9-0c69216a6f52 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:42.918347 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-df27c411-48a3-4d6e-91c9-0c69216a6f52 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:42.922507 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-df27c411-48a3-4d6e-91c9-0c69216a6f52 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:42.923552 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-df27c411-48a3-4d6e-91c9-0c69216a6f52 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:43.025357 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-003c48f1-9885-4bae-9f74-455483921fd4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Flavor limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 09 13:11:43.026108 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-003c48f1-9885-4bae-9f74-455483921fd4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Image limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 09 13:11:43.026233 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-003c48f1-9885-4bae-9f74-455483921fd4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Flavor pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 09 13:11:43.026672 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-003c48f1-9885-4bae-9f74-455483921fd4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Image pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 09 13:11:43.027892 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-003c48f1-9885-4bae-9f74-455483921fd4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 09 13:11:43.064656 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-003c48f1-9885-4bae-9f74-455483921fd4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:43.066010 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-003c48f1-9885-4bae-9f74-455483921fd4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:43.072229 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-003c48f1-9885-4bae-9f74-455483921fd4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:43.078202 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-003c48f1-9885-4bae-9f74-455483921fd4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:43.127949 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-003c48f1-9885-4bae-9f74-455483921fd4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Getting quotas for project 989aed5dea7448f6aff599d6744ccec0. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:11:43.137758 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-003c48f1-9885-4bae-9f74-455483921fd4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Getting quotas for user 99cec126a43b4dc2b0f18af629b718ac and project 989aed5dea7448f6aff599d6744ccec0. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:11:43.162838 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-003c48f1-9885-4bae-9f74-455483921fd4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Going to run 1 instances... {{(pid=116749) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 09 13:11:43.165281 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-003c48f1-9885-4bae-9f74-455483921fd4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af86cedd-e7d5-4a28-a810-f47830f4bffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 09 13:11:43.300556 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-003c48f1-9885-4bae-9f74-455483921fd4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.522625 Feb 09 13:11:43.301216 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 31/71] 10.222.0.84 () {60 vars in 1146 bytes} [Wed Feb 9 13:11:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 09 13:11:43.319810 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-a7f9d80d-3ef2-4205-a230-9f8bef7c9586 req-39a54125-76d2-451e-a90f-90b32f08dad3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d2bee05-65c9-445a-a7ca-98808614d991", "tag": "0a218b4e-3337-4b9d-9226-b484077f2606"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:11:43.336814 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:11:43.336814 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:11:43.351382 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-a7f9d80d-3ef2-4205-a230-9f8bef7c9586 req-39a54125-76d2-451e-a90f-90b32f08dad3 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:43.352382 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-a7f9d80d-3ef2-4205-a230-9f8bef7c9586 req-39a54125-76d2-451e-a90f-90b32f08dad3 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:43.399095 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-a7f9d80d-3ef2-4205-a230-9f8bef7c9586 req-39a54125-76d2-451e-a90f-90b32f08dad3 service nova] Creating event network-changed:0a218b4e-3337-4b9d-9226-b484077f2606 for instance 7d2bee05-65c9-445a-a7ca-98808614d991 on hv-cinder-82786 Feb 09 13:11:43.416573 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-a7f9d80d-3ef2-4205-a230-9f8bef7c9586 req-39a54125-76d2-451e-a90f-90b32f08dad3 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114058 Feb 09 13:11:43.417217 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 32/72] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:11:43.434362 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-3eceb5cf-7eab-4fdf-97d9-2d9118be0068 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:43.435102 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-3eceb5cf-7eab-4fdf-97d9-2d9118be0068 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:43.452751 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3eceb5cf-7eab-4fdf-97d9-2d9118be0068 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:43.452751 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3eceb5cf-7eab-4fdf-97d9-2d9118be0068 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:43.459498 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3eceb5cf-7eab-4fdf-97d9-2d9118be0068 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:43.460252 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3eceb5cf-7eab-4fdf-97d9-2d9118be0068 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:43.548890 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-df27c411-48a3-4d6e-91c9-0c69216a6f52 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:43.565346 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-df27c411-48a3-4d6e-91c9-0c69216a6f52 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1315 microversion: 2.1 time: 0.675130 Feb 09 13:11:43.567707 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 41/73] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:42 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1315 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:43.572521 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-323734c5-5ada-4212-bcf9-07c8a485fd23 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:43.573378 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-323734c5-5ada-4212-bcf9-07c8a485fd23 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:43.687040 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-323734c5-5ada-4212-bcf9-07c8a485fd23 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:43.693764 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-323734c5-5ada-4212-bcf9-07c8a485fd23 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b" status: 200 len: 1213 microversion: 2.1 time: 0.125071 Feb 09 13:11:43.694342 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 42/74] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:43 2022] GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b => generated 1213 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:43.699364 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-e8c7d0a5-1f1a-42d3-acf1-348b987897d9 req-2696ecb6-2137-4ed1-807c-2334a42d4d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f002ff5-5d1f-4467-95ed-59f40d89a99d", "tag": "f0f66d6e-dac2-4b65-a7f0-da58e82e9c63"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:11:43.701778 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:11:43.701778 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:11:43.716425 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-e8c7d0a5-1f1a-42d3-acf1-348b987897d9 req-2696ecb6-2137-4ed1-807c-2334a42d4d5d service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:43.717170 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-e8c7d0a5-1f1a-42d3-acf1-348b987897d9 req-2696ecb6-2137-4ed1-807c-2334a42d4d5d service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:43.738165 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-e8c7d0a5-1f1a-42d3-acf1-348b987897d9 req-2696ecb6-2137-4ed1-807c-2334a42d4d5d service nova] Creating event network-changed:f0f66d6e-dac2-4b65-a7f0-da58e82e9c63 for instance 8f002ff5-5d1f-4467-95ed-59f40d89a99d on hv-cinder-82786 Feb 09 13:11:43.739009 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-e8c7d0a5-1f1a-42d3-acf1-348b987897d9 req-2696ecb6-2137-4ed1-807c-2334a42d4d5d service nova] Acquired lock "compute-rpcapi-router" {{(pid=116748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 09 13:11:43.740311 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b73bd654-3d3f-47c5-862f-9eb35980689c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:43.740903 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b73bd654-3d3f-47c5-862f-9eb35980689c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:43.741925 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b73bd654-3d3f-47c5-862f-9eb35980689c None None] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:43.742667 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b73bd654-3d3f-47c5-862f-9eb35980689c None None] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:43.751656 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.compute.rpcapi [None req-b73bd654-3d3f-47c5-862f-9eb35980689c None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Feb 09 13:11:43.752849 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b73bd654-3d3f-47c5-862f-9eb35980689c None None] Releasing lock "compute-rpcapi-router" {{(pid=116748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 09 13:11:43.769790 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-b73bd654-3d3f-47c5-862f-9eb35980689c None None] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073999 Feb 09 13:11:43.770466 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 43/75] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:11:43.776826 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-de00f027-1203-45ef-911f-aa5900895ff2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:43.777576 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-de00f027-1203-45ef-911f-aa5900895ff2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:43.788331 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-de00f027-1203-45ef-911f-aa5900895ff2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:43.788968 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-de00f027-1203-45ef-911f-aa5900895ff2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:43.790502 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-de00f027-1203-45ef-911f-aa5900895ff2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:43.791850 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-de00f027-1203-45ef-911f-aa5900895ff2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:44.041551 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3eceb5cf-7eab-4fdf-97d9-2d9118be0068 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:44.049325 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-3eceb5cf-7eab-4fdf-97d9-2d9118be0068 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1322 microversion: 2.1 time: 0.629061 Feb 09 13:11:44.052835 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-de00f027-1203-45ef-911f-aa5900895ff2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:44.053137 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 33/76] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:43 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1322 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:44.068376 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-de00f027-1203-45ef-911f-aa5900895ff2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1317 microversion: 2.1 time: 0.296116 Feb 09 13:11:44.074449 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-65b668ca-eae3-40ac-b108-77f8b2733e2a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:44.075117 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-65b668ca-eae3-40ac-b108-77f8b2733e2a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:44.089587 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 44/77] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:43 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:44.090919 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-65b668ca-eae3-40ac-b108-77f8b2733e2a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:44.091696 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-65b668ca-eae3-40ac-b108-77f8b2733e2a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:44.092698 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-65b668ca-eae3-40ac-b108-77f8b2733e2a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:44.094237 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-65b668ca-eae3-40ac-b108-77f8b2733e2a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:44.494143 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-65b668ca-eae3-40ac-b108-77f8b2733e2a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:44.502461 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-65b668ca-eae3-40ac-b108-77f8b2733e2a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1364 microversion: 2.1 time: 0.439422 Feb 09 13:11:44.507799 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 34/78] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:44 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1364 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:44.583574 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-5a63352c-cfce-4afe-bc72-8bffd711118e tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:44.584203 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-5a63352c-cfce-4afe-bc72-8bffd711118e tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:44.597120 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5a63352c-cfce-4afe-bc72-8bffd711118e tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:44.597576 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5a63352c-cfce-4afe-bc72-8bffd711118e tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:44.598573 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5a63352c-cfce-4afe-bc72-8bffd711118e tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:44.599167 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5a63352c-cfce-4afe-bc72-8bffd711118e tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:44.710788 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ed61bcd3-98df-45d6-9532-79e8da469c49 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:44.711565 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-ed61bcd3-98df-45d6-9532-79e8da469c49 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:44.812497 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ed61bcd3-98df-45d6-9532-79e8da469c49 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:44.819774 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-ed61bcd3-98df-45d6-9532-79e8da469c49 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b" status: 200 len: 1213 microversion: 2.1 time: 0.112766 Feb 09 13:11:44.822994 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 35/79] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:44 2022] GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b => generated 1213 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:45.025103 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-5a63352c-cfce-4afe-bc72-8bffd711118e tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:45.037991 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-5a63352c-cfce-4afe-bc72-8bffd711118e tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1315 microversion: 2.1 time: 0.458138 Feb 09 13:11:45.038850 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 45/80] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:44 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:45.069450 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-18f1c902-01b5-4d4e-a07d-698225774b1c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:45.071445 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-18f1c902-01b5-4d4e-a07d-698225774b1c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:45.084807 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-13f51a5e-22a1-46ee-8101-24118f5bb769 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:45.085430 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-13f51a5e-22a1-46ee-8101-24118f5bb769 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:45.087835 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-18f1c902-01b5-4d4e-a07d-698225774b1c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:45.091418 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-18f1c902-01b5-4d4e-a07d-698225774b1c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:45.091974 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-13f51a5e-22a1-46ee-8101-24118f5bb769 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:45.092341 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-18f1c902-01b5-4d4e-a07d-698225774b1c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:45.092770 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-13f51a5e-22a1-46ee-8101-24118f5bb769 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:45.092886 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-18f1c902-01b5-4d4e-a07d-698225774b1c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:45.093820 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-13f51a5e-22a1-46ee-8101-24118f5bb769 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:45.094464 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-13f51a5e-22a1-46ee-8101-24118f5bb769 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:45.473293 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-13f51a5e-22a1-46ee-8101-24118f5bb769 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:45.481585 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-13f51a5e-22a1-46ee-8101-24118f5bb769 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1317 microversion: 2.1 time: 0.400260 Feb 09 13:11:45.482198 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 46/81] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:45 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:45.525481 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-be349053-2cc8-4a01-b92c-e0f5e839692b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:45.526393 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-be349053-2cc8-4a01-b92c-e0f5e839692b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:45.537173 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-be349053-2cc8-4a01-b92c-e0f5e839692b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:45.543676 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-be349053-2cc8-4a01-b92c-e0f5e839692b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:45.545683 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-be349053-2cc8-4a01-b92c-e0f5e839692b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:45.546836 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-be349053-2cc8-4a01-b92c-e0f5e839692b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:45.735949 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-18f1c902-01b5-4d4e-a07d-698225774b1c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:45.749695 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-18f1c902-01b5-4d4e-a07d-698225774b1c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1322 microversion: 2.1 time: 0.684230 Feb 09 13:11:45.750414 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 36/82] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:45 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1322 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:45.793041 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-be349053-2cc8-4a01-b92c-e0f5e839692b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:45.801431 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-be349053-2cc8-4a01-b92c-e0f5e839692b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1364 microversion: 2.1 time: 0.280704 Feb 09 13:11:45.802217 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 47/83] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:45 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1364 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:45.810889 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-27d4d219-a6ec-42e6-ab70-150fba2ab49e req-8bd3d97b-3a82-43b7-a20d-a6b5bc378063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6851d5fe-b010-49cc-8696-19a1008c2beb", "tag": "e603fae6-8816-4c72-bb3a-419850a3b7de"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:11:45.812526 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:11:45.812526 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:11:45.819964 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-27d4d219-a6ec-42e6-ab70-150fba2ab49e req-8bd3d97b-3a82-43b7-a20d-a6b5bc378063 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:45.822206 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-27d4d219-a6ec-42e6-ab70-150fba2ab49e req-8bd3d97b-3a82-43b7-a20d-a6b5bc378063 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:45.837045 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-27d4d219-a6ec-42e6-ab70-150fba2ab49e req-8bd3d97b-3a82-43b7-a20d-a6b5bc378063 service nova] Creating event network-changed:e603fae6-8816-4c72-bb3a-419850a3b7de for instance 6851d5fe-b010-49cc-8696-19a1008c2beb on hv-cinder-82786 Feb 09 13:11:45.842245 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-05c82f8c-9de5-4fff-8b5f-134ef6003f9b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:45.843209 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-05c82f8c-9de5-4fff-8b5f-134ef6003f9b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:45.844638 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-27d4d219-a6ec-42e6-ab70-150fba2ab49e req-8bd3d97b-3a82-43b7-a20d-a6b5bc378063 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037208 Feb 09 13:11:45.845773 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 37/84] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:11:45.849971 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-05c82f8c-9de5-4fff-8b5f-134ef6003f9b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:45.850777 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-05c82f8c-9de5-4fff-8b5f-134ef6003f9b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:45.851761 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-05c82f8c-9de5-4fff-8b5f-134ef6003f9b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:45.852281 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-05c82f8c-9de5-4fff-8b5f-134ef6003f9b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:45.933795 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-05c82f8c-9de5-4fff-8b5f-134ef6003f9b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:45.943522 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-05c82f8c-9de5-4fff-8b5f-134ef6003f9b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b" status: 200 len: 1265 microversion: 2.1 time: 0.109353 Feb 09 13:11:45.946409 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 48/85] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:45 2022] GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b => generated 1265 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:46.062289 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-16155b1a-6bcf-467b-b55d-f20fb7cfc5b8 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:46.063361 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-16155b1a-6bcf-467b-b55d-f20fb7cfc5b8 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:46.073925 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-16155b1a-6bcf-467b-b55d-f20fb7cfc5b8 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:46.074845 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-16155b1a-6bcf-467b-b55d-f20fb7cfc5b8 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:46.079798 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-16155b1a-6bcf-467b-b55d-f20fb7cfc5b8 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:46.079798 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-16155b1a-6bcf-467b-b55d-f20fb7cfc5b8 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:46.335350 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-16155b1a-6bcf-467b-b55d-f20fb7cfc5b8 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:46.349757 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-16155b1a-6bcf-467b-b55d-f20fb7cfc5b8 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1315 microversion: 2.1 time: 0.296281 Feb 09 13:11:46.361252 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 38/86] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:46 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:46.502226 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-a69d32a3-d2c0-4745-a54a-6a9bf2608153 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:46.503468 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-a69d32a3-d2c0-4745-a54a-6a9bf2608153 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:46.515368 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a69d32a3-d2c0-4745-a54a-6a9bf2608153 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:46.516541 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a69d32a3-d2c0-4745-a54a-6a9bf2608153 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:46.518191 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a69d32a3-d2c0-4745-a54a-6a9bf2608153 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:46.518990 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a69d32a3-d2c0-4745-a54a-6a9bf2608153 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:46.767147 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-73112db7-bdb2-42e5-b3d0-44968f34cdb5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:46.768168 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-73112db7-bdb2-42e5-b3d0-44968f34cdb5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:46.775730 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-73112db7-bdb2-42e5-b3d0-44968f34cdb5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:46.777273 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-73112db7-bdb2-42e5-b3d0-44968f34cdb5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:46.779844 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-73112db7-bdb2-42e5-b3d0-44968f34cdb5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:46.780519 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-73112db7-bdb2-42e5-b3d0-44968f34cdb5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:46.926597 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a69d32a3-d2c0-4745-a54a-6a9bf2608153 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:46.936156 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-a69d32a3-d2c0-4745-a54a-6a9bf2608153 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1317 microversion: 2.1 time: 0.439050 Feb 09 13:11:46.936940 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 49/87] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:46 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:46.945796 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-ddeb2e84-3008-4c28-acb6-bcda27dafad3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:46.947565 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-ddeb2e84-3008-4c28-acb6-bcda27dafad3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:46.959150 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ddeb2e84-3008-4c28-acb6-bcda27dafad3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:46.961696 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ddeb2e84-3008-4c28-acb6-bcda27dafad3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:46.964454 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ddeb2e84-3008-4c28-acb6-bcda27dafad3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:46.964980 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ddeb2e84-3008-4c28-acb6-bcda27dafad3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:47.042031 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-73112db7-bdb2-42e5-b3d0-44968f34cdb5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:47.049363 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-73112db7-bdb2-42e5-b3d0-44968f34cdb5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1322 microversion: 2.1 time: 0.286040 Feb 09 13:11:47.052645 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 39/88] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:46 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:47.068692 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-2631ff52-9eb8-4c05-89f1-841c0c773b51 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:47.069031 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-2631ff52-9eb8-4c05-89f1-841c0c773b51 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:47.076427 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2631ff52-9eb8-4c05-89f1-841c0c773b51 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:47.077633 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2631ff52-9eb8-4c05-89f1-841c0c773b51 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:47.078949 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2631ff52-9eb8-4c05-89f1-841c0c773b51 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:47.079566 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2631ff52-9eb8-4c05-89f1-841c0c773b51 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:47.157276 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ddeb2e84-3008-4c28-acb6-bcda27dafad3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:47.164973 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-ddeb2e84-3008-4c28-acb6-bcda27dafad3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1364 microversion: 2.1 time: 0.226021 Feb 09 13:11:47.166822 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 50/89] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:46 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:47.190807 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-2631ff52-9eb8-4c05-89f1-841c0c773b51 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:47.201203 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-2631ff52-9eb8-4c05-89f1-841c0c773b51 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b" status: 200 len: 1271 microversion: 2.1 time: 0.147346 Feb 09 13:11:47.202128 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 40/90] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:47 2022] GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b => generated 1271 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:47.369253 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-898e6ff2-9376-4fdc-85dc-cb528b2bc723 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:47.369983 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-898e6ff2-9376-4fdc-85dc-cb528b2bc723 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:47.375917 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-898e6ff2-9376-4fdc-85dc-cb528b2bc723 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:47.376377 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-898e6ff2-9376-4fdc-85dc-cb528b2bc723 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:47.377177 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-898e6ff2-9376-4fdc-85dc-cb528b2bc723 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:47.377621 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-898e6ff2-9376-4fdc-85dc-cb528b2bc723 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:47.538500 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-898e6ff2-9376-4fdc-85dc-cb528b2bc723 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:47.545873 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-898e6ff2-9376-4fdc-85dc-cb528b2bc723 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1315 microversion: 2.1 time: 0.180928 Feb 09 13:11:47.546450 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 51/91] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:47 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:47.952722 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-adb91354-be2a-441f-8ad9-f068b048c3b9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:47.953597 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-adb91354-be2a-441f-8ad9-f068b048c3b9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:47.965080 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-adb91354-be2a-441f-8ad9-f068b048c3b9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:47.965677 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-adb91354-be2a-441f-8ad9-f068b048c3b9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:47.966635 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-adb91354-be2a-441f-8ad9-f068b048c3b9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:47.967386 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-adb91354-be2a-441f-8ad9-f068b048c3b9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:48.068962 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-b21bf1d0-40f1-410c-b5af-6b174e3a8e2d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:48.069581 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-b21bf1d0-40f1-410c-b5af-6b174e3a8e2d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:48.082871 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b21bf1d0-40f1-410c-b5af-6b174e3a8e2d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:48.083484 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b21bf1d0-40f1-410c-b5af-6b174e3a8e2d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:48.084620 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b21bf1d0-40f1-410c-b5af-6b174e3a8e2d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:48.085513 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b21bf1d0-40f1-410c-b5af-6b174e3a8e2d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:48.328248 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-adb91354-be2a-441f-8ad9-f068b048c3b9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:48.338540 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-adb91354-be2a-441f-8ad9-f068b048c3b9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1317 microversion: 2.1 time: 0.389949 Feb 09 13:11:48.344166 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 41/92] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:47 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:48.349775 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-864eb4b9-7032-4783-b2c1-479ba3929c41 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:48.350896 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-864eb4b9-7032-4783-b2c1-479ba3929c41 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:48.359560 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-b21bf1d0-40f1-410c-b5af-6b174e3a8e2d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:48.370934 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-b21bf1d0-40f1-410c-b5af-6b174e3a8e2d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1322 microversion: 2.1 time: 0.304347 Feb 09 13:11:48.375519 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-864eb4b9-7032-4783-b2c1-479ba3929c41 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:48.376291 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-864eb4b9-7032-4783-b2c1-479ba3929c41 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:48.378347 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-864eb4b9-7032-4783-b2c1-479ba3929c41 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:48.379029 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-864eb4b9-7032-4783-b2c1-479ba3929c41 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:48.379133 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 52/93] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:48 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:48.394956 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-47a92ae2-7a54-42a5-9111-6cf0470fbf51 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:48.395614 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-47a92ae2-7a54-42a5-9111-6cf0470fbf51 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:48.407906 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-47a92ae2-7a54-42a5-9111-6cf0470fbf51 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:48.408373 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-47a92ae2-7a54-42a5-9111-6cf0470fbf51 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:48.413485 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-47a92ae2-7a54-42a5-9111-6cf0470fbf51 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:48.414001 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-47a92ae2-7a54-42a5-9111-6cf0470fbf51 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:48.655486 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-47a92ae2-7a54-42a5-9111-6cf0470fbf51 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:48.655486 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-47a92ae2-7a54-42a5-9111-6cf0470fbf51 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b" status: 200 len: 1313 microversion: 2.1 time: 0.268468 Feb 09 13:11:48.655486 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 53/94] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:48 2022] GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:48.663736 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-633acf9d-be5e-4fcf-bb24-3657b68cfe2d req-dfc5fea8-e04e-44f6-9496-bbac7a62eef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a679ac91-50c0-4efc-ae25-c630fd14986b", "tag": "98fadb8e-f344-43c4-a8db-ee5bc28b5134"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:11:48.666230 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:11:48.666230 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:11:48.677206 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-633acf9d-be5e-4fcf-bb24-3657b68cfe2d req-dfc5fea8-e04e-44f6-9496-bbac7a62eef6 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:48.678040 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-633acf9d-be5e-4fcf-bb24-3657b68cfe2d req-dfc5fea8-e04e-44f6-9496-bbac7a62eef6 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:48.694511 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-633acf9d-be5e-4fcf-bb24-3657b68cfe2d req-dfc5fea8-e04e-44f6-9496-bbac7a62eef6 service nova] Creating event network-changed:98fadb8e-f344-43c4-a8db-ee5bc28b5134 for instance a679ac91-50c0-4efc-ae25-c630fd14986b on hv-cinder-82786 Feb 09 13:11:48.742545 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-633acf9d-be5e-4fcf-bb24-3657b68cfe2d req-dfc5fea8-e04e-44f6-9496-bbac7a62eef6 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052250 Feb 09 13:11:48.742545 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 54/95] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:11:48.742545 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-7d16da0f-d685-46f0-88f2-3690288b239f tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:48.742545 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-7d16da0f-d685-46f0-88f2-3690288b239f tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:48.742545 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7d16da0f-d685-46f0-88f2-3690288b239f tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:48.743855 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7d16da0f-d685-46f0-88f2-3690288b239f tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:48.743855 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7d16da0f-d685-46f0-88f2-3690288b239f tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:48.743855 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7d16da0f-d685-46f0-88f2-3690288b239f tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:48.759995 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-864eb4b9-7032-4783-b2c1-479ba3929c41 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:48.772445 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-864eb4b9-7032-4783-b2c1-479ba3929c41 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1364 microversion: 2.1 time: 0.423542 Feb 09 13:11:48.774630 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 42/96] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:48 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1364 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:48.922597 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-7d16da0f-d685-46f0-88f2-3690288b239f tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:48.935538 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-7d16da0f-d685-46f0-88f2-3690288b239f tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1315 microversion: 2.1 time: 0.225802 Feb 09 13:11:48.935538 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 55/97] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:48 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:48.936678 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-75094169-f0cf-4c42-a245-3eb0d79756bb req-0e01dca0-28e5-4a2f-b720-bd2798f250fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3449e9bb-2fd1-40a5-8003-d773c6d60736", "name": "network-vif-plugged", "status": "completed", "tag": "65961941-2a92-4fd6-a368-cadf07ece780"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:11:48.938503 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:11:48.938503 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:11:48.947170 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-75094169-f0cf-4c42-a245-3eb0d79756bb req-0e01dca0-28e5-4a2f-b720-bd2798f250fd service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:48.947616 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-75094169-f0cf-4c42-a245-3eb0d79756bb req-0e01dca0-28e5-4a2f-b720-bd2798f250fd service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:48.960081 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-75094169-f0cf-4c42-a245-3eb0d79756bb req-0e01dca0-28e5-4a2f-b720-bd2798f250fd service nova] Creating event network-vif-plugged:65961941-2a92-4fd6-a368-cadf07ece780 for instance 3449e9bb-2fd1-40a5-8003-d773c6d60736 on hv-cinder-82786 Feb 09 13:11:48.965940 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-75094169-f0cf-4c42-a245-3eb0d79756bb req-0e01dca0-28e5-4a2f-b720-bd2798f250fd service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117813 Feb 09 13:11:48.967256 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 43/98] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:11:49.359447 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-5cfdc147-1357-4593-89ee-534d8d762c9c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:49.360726 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-5cfdc147-1357-4593-89ee-534d8d762c9c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:49.367844 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5cfdc147-1357-4593-89ee-534d8d762c9c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:49.368676 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5cfdc147-1357-4593-89ee-534d8d762c9c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:49.373133 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5cfdc147-1357-4593-89ee-534d8d762c9c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:49.373133 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5cfdc147-1357-4593-89ee-534d8d762c9c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:49.413381 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8c0e92d6-8adc-41e5-b81f-fd7797cf9df6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:49.414649 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8c0e92d6-8adc-41e5-b81f-fd7797cf9df6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:49.459232 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8c0e92d6-8adc-41e5-b81f-fd7797cf9df6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:49.462369 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8c0e92d6-8adc-41e5-b81f-fd7797cf9df6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:49.462369 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8c0e92d6-8adc-41e5-b81f-fd7797cf9df6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:49.462369 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8c0e92d6-8adc-41e5-b81f-fd7797cf9df6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:49.763384 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8c0e92d6-8adc-41e5-b81f-fd7797cf9df6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:49.778279 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8c0e92d6-8adc-41e5-b81f-fd7797cf9df6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1322 microversion: 2.1 time: 0.385037 Feb 09 13:11:49.783418 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 44/99] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:49 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:49.803233 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-1bc6a2d9-0294-4460-8f6f-8c4c40ae0fa7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:49.806441 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-1bc6a2d9-0294-4460-8f6f-8c4c40ae0fa7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:49.833670 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-5cfdc147-1357-4593-89ee-534d8d762c9c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:49.846774 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1bc6a2d9-0294-4460-8f6f-8c4c40ae0fa7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:49.849960 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-5cfdc147-1357-4593-89ee-534d8d762c9c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1317 microversion: 2.1 time: 0.493895 Feb 09 13:11:49.851066 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 56/100] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:49 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1317 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:49.853318 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1bc6a2d9-0294-4460-8f6f-8c4c40ae0fa7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:49.855076 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1bc6a2d9-0294-4460-8f6f-8c4c40ae0fa7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:49.855972 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1bc6a2d9-0294-4460-8f6f-8c4c40ae0fa7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:49.863912 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-76c1595f-24de-4e72-8bea-6d6035600f8e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:49.864854 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-76c1595f-24de-4e72-8bea-6d6035600f8e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:49.877226 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-76c1595f-24de-4e72-8bea-6d6035600f8e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:49.882992 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-76c1595f-24de-4e72-8bea-6d6035600f8e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:49.882992 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-76c1595f-24de-4e72-8bea-6d6035600f8e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:49.882992 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-76c1595f-24de-4e72-8bea-6d6035600f8e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:50.099117 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-76c1595f-24de-4e72-8bea-6d6035600f8e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:50.107042 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-76c1595f-24de-4e72-8bea-6d6035600f8e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1364 microversion: 2.1 time: 0.251681 Feb 09 13:11:50.108595 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 57/101] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:49 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1364 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:50.125295 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-26546a2a-a939-48af-9d51-74252ded7e83 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:50.125934 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-26546a2a-a939-48af-9d51-74252ded7e83 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:50.132235 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-1bc6a2d9-0294-4460-8f6f-8c4c40ae0fa7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:50.142880 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-26546a2a-a939-48af-9d51-74252ded7e83 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:50.143785 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-26546a2a-a939-48af-9d51-74252ded7e83 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:50.144806 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-26546a2a-a939-48af-9d51-74252ded7e83 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:50.145295 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-26546a2a-a939-48af-9d51-74252ded7e83 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:50.146338 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-1bc6a2d9-0294-4460-8f6f-8c4c40ae0fa7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b" status: 200 len: 1313 microversion: 2.1 time: 0.363980 Feb 09 13:11:50.147102 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 45/102] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:49 2022] GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:50.398936 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-26546a2a-a939-48af-9d51-74252ded7e83 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:50.406808 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-26546a2a-a939-48af-9d51-74252ded7e83 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1315 microversion: 2.1 time: 0.291783 Feb 09 13:11:50.407392 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 58/103] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:50 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:50.796187 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-729d345a-f939-4d5a-b6f0-d1e7027f0876 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:50.796806 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-729d345a-f939-4d5a-b6f0-d1e7027f0876 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:50.802779 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-729d345a-f939-4d5a-b6f0-d1e7027f0876 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:50.803236 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-729d345a-f939-4d5a-b6f0-d1e7027f0876 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:50.804028 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-729d345a-f939-4d5a-b6f0-d1e7027f0876 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:50.804468 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-729d345a-f939-4d5a-b6f0-d1e7027f0876 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:50.866305 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-84299f2a-59f5-40e7-b9b8-0b933a1a33ba tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:50.867282 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-84299f2a-59f5-40e7-b9b8-0b933a1a33ba tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:50.873864 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-84299f2a-59f5-40e7-b9b8-0b933a1a33ba tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:50.874744 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-84299f2a-59f5-40e7-b9b8-0b933a1a33ba tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:50.875636 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-84299f2a-59f5-40e7-b9b8-0b933a1a33ba tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:50.876172 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-84299f2a-59f5-40e7-b9b8-0b933a1a33ba tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:50.991963 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-729d345a-f939-4d5a-b6f0-d1e7027f0876 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:51.000860 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-729d345a-f939-4d5a-b6f0-d1e7027f0876 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1322 microversion: 2.1 time: 0.208244 Feb 09 13:11:51.009107 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 46/104] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:50 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:51.011280 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-7cb4a275-2e6c-4795-822c-f68e4ab31d86 req-89c05a32-0a5b-4466-a6f1-02b61df00584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894904de-6d54-4785-b905-4a1901d9d87f", "name": "network-vif-plugged", "status": "completed", "tag": "0c7a08f1-289e-49bd-b9bc-e830edeaee6f"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:11:51.012849 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:11:51.012849 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:11:51.021373 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-7cb4a275-2e6c-4795-822c-f68e4ab31d86 req-89c05a32-0a5b-4466-a6f1-02b61df00584 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:51.021821 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-7cb4a275-2e6c-4795-822c-f68e4ab31d86 req-89c05a32-0a5b-4466-a6f1-02b61df00584 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:51.035402 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-7cb4a275-2e6c-4795-822c-f68e4ab31d86 req-89c05a32-0a5b-4466-a6f1-02b61df00584 service nova] Creating event network-vif-plugged:0c7a08f1-289e-49bd-b9bc-e830edeaee6f for instance 894904de-6d54-4785-b905-4a1901d9d87f on hv-cinder-82786 Feb 09 13:11:51.042171 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-7cb4a275-2e6c-4795-822c-f68e4ab31d86 req-89c05a32-0a5b-4466-a6f1-02b61df00584 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038402 Feb 09 13:11:51.042808 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 47/105] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:11:51.056504 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-84299f2a-59f5-40e7-b9b8-0b933a1a33ba tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:51.066548 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-84299f2a-59f5-40e7-b9b8-0b933a1a33ba tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1317 microversion: 2.1 time: 0.201291 Feb 09 13:11:51.066548 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 59/106] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:50 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:51.125371 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-7b211f63-dfa2-4578-934b-ea6b813918ee tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:51.126061 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-7b211f63-dfa2-4578-934b-ea6b813918ee tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:51.132166 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7b211f63-dfa2-4578-934b-ea6b813918ee tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:51.132617 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7b211f63-dfa2-4578-934b-ea6b813918ee tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:51.133439 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7b211f63-dfa2-4578-934b-ea6b813918ee tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:51.133891 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7b211f63-dfa2-4578-934b-ea6b813918ee tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:51.165243 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-7990a731-9111-48b2-9c2c-2a8a7ce50237 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:51.165883 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-7990a731-9111-48b2-9c2c-2a8a7ce50237 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:51.172168 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7990a731-9111-48b2-9c2c-2a8a7ce50237 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:51.172626 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7990a731-9111-48b2-9c2c-2a8a7ce50237 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:51.173448 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7990a731-9111-48b2-9c2c-2a8a7ce50237 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:51.173914 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7990a731-9111-48b2-9c2c-2a8a7ce50237 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:51.283233 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-7b211f63-dfa2-4578-934b-ea6b813918ee tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:51.300781 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-7b211f63-dfa2-4578-934b-ea6b813918ee tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1364 microversion: 2.1 time: 0.170118 Feb 09 13:11:51.300781 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 48/107] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:51 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:51.327591 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-7990a731-9111-48b2-9c2c-2a8a7ce50237 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:51.339244 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-7990a731-9111-48b2-9c2c-2a8a7ce50237 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b" status: 200 len: 1313 microversion: 2.1 time: 0.178505 Feb 09 13:11:51.340224 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 60/108] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:51 2022] GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:51.425677 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-b22d4a1f-e740-48e2-b1c8-f664fdd48f65 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:51.426589 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-b22d4a1f-e740-48e2-b1c8-f664fdd48f65 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:51.435230 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b22d4a1f-e740-48e2-b1c8-f664fdd48f65 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:51.436064 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b22d4a1f-e740-48e2-b1c8-f664fdd48f65 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:51.437028 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b22d4a1f-e740-48e2-b1c8-f664fdd48f65 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:51.437655 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b22d4a1f-e740-48e2-b1c8-f664fdd48f65 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:51.598241 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-b22d4a1f-e740-48e2-b1c8-f664fdd48f65 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:51.605450 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-b22d4a1f-e740-48e2-b1c8-f664fdd48f65 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1315 microversion: 2.1 time: 0.185137 Feb 09 13:11:51.606009 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 49/109] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:51 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:52.019039 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-6c55570b-f294-4648-9ebb-be795e19a1da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:52.019844 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-6c55570b-f294-4648-9ebb-be795e19a1da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:52.027917 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6c55570b-f294-4648-9ebb-be795e19a1da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:52.028730 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6c55570b-f294-4648-9ebb-be795e19a1da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:52.029762 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6c55570b-f294-4648-9ebb-be795e19a1da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:52.030194 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6c55570b-f294-4648-9ebb-be795e19a1da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:52.081518 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-3feca5b3-ea03-407b-afb4-50de052dce70 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:52.082214 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-3feca5b3-ea03-407b-afb4-50de052dce70 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:52.089044 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3feca5b3-ea03-407b-afb4-50de052dce70 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:52.101988 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3feca5b3-ea03-407b-afb4-50de052dce70 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:52.101988 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3feca5b3-ea03-407b-afb4-50de052dce70 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:52.101988 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3feca5b3-ea03-407b-afb4-50de052dce70 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:52.205463 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6c55570b-f294-4648-9ebb-be795e19a1da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:52.222887 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-6c55570b-f294-4648-9ebb-be795e19a1da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1322 microversion: 2.1 time: 0.208272 Feb 09 13:11:52.223475 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 61/110] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:52 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:52.267905 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3feca5b3-ea03-407b-afb4-50de052dce70 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:52.276442 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-3feca5b3-ea03-407b-afb4-50de052dce70 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1317 microversion: 2.1 time: 0.199052 Feb 09 13:11:52.277025 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 50/111] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:52 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:52.307990 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-eb78aa2d-0142-4e1e-9bc8-e73bf5c954c1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:52.314644 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-eb78aa2d-0142-4e1e-9bc8-e73bf5c954c1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:52.314644 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-eb78aa2d-0142-4e1e-9bc8-e73bf5c954c1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:52.315064 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-eb78aa2d-0142-4e1e-9bc8-e73bf5c954c1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:52.316016 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-eb78aa2d-0142-4e1e-9bc8-e73bf5c954c1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:52.316632 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-eb78aa2d-0142-4e1e-9bc8-e73bf5c954c1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:52.356806 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-fbcd5656-7b96-449a-bf3d-db18920962d1 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:52.358296 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-fbcd5656-7b96-449a-bf3d-db18920962d1 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:52.365822 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-fbcd5656-7b96-449a-bf3d-db18920962d1 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:52.366360 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-fbcd5656-7b96-449a-bf3d-db18920962d1 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:52.367283 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-fbcd5656-7b96-449a-bf3d-db18920962d1 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:52.367896 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-fbcd5656-7b96-449a-bf3d-db18920962d1 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:52.514024 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-eb78aa2d-0142-4e1e-9bc8-e73bf5c954c1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:52.524595 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-eb78aa2d-0142-4e1e-9bc8-e73bf5c954c1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1364 microversion: 2.1 time: 0.219293 Feb 09 13:11:52.535411 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 62/112] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:52 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:52.577775 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-fbcd5656-7b96-449a-bf3d-db18920962d1 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:52.593418 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-fbcd5656-7b96-449a-bf3d-db18920962d1 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b" status: 200 len: 1313 microversion: 2.1 time: 0.240807 Feb 09 13:11:52.595656 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 51/113] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:52 2022] GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:52.621530 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-a56cdb17-ed23-4700-8a2e-712d0caff6f1 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:52.622146 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-a56cdb17-ed23-4700-8a2e-712d0caff6f1 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:52.630768 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a56cdb17-ed23-4700-8a2e-712d0caff6f1 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:52.634854 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a56cdb17-ed23-4700-8a2e-712d0caff6f1 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:52.634854 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a56cdb17-ed23-4700-8a2e-712d0caff6f1 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:52.634854 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a56cdb17-ed23-4700-8a2e-712d0caff6f1 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:52.795501 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a56cdb17-ed23-4700-8a2e-712d0caff6f1 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:52.808233 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-a56cdb17-ed23-4700-8a2e-712d0caff6f1 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1502 microversion: 2.1 time: 0.189610 Feb 09 13:11:52.809507 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 63/114] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:52 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1502 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:53.061411 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-8ae8db01-bf46-4008-806e-5e7303c12fd3 req-a704756a-8958-44e6-9822-9889d15e365c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6851d5fe-b010-49cc-8696-19a1008c2beb", "name": "network-vif-plugged", "status": "completed", "tag": "e603fae6-8816-4c72-bb3a-419850a3b7de"}, {"server_uuid": "7d2bee05-65c9-445a-a7ca-98808614d991", "name": "network-vif-plugged", "status": "completed", "tag": "0a218b4e-3337-4b9d-9226-b484077f2606"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:11:53.063317 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:11:53.063317 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:11:53.075284 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-8ae8db01-bf46-4008-806e-5e7303c12fd3 req-a704756a-8958-44e6-9822-9889d15e365c service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:53.075737 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-8ae8db01-bf46-4008-806e-5e7303c12fd3 req-a704756a-8958-44e6-9822-9889d15e365c service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:53.088602 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-8ae8db01-bf46-4008-806e-5e7303c12fd3 req-a704756a-8958-44e6-9822-9889d15e365c service nova] Creating event network-vif-plugged:e603fae6-8816-4c72-bb3a-419850a3b7de for instance 6851d5fe-b010-49cc-8696-19a1008c2beb on hv-cinder-82786 Feb 09 13:11:53.089136 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-8ae8db01-bf46-4008-806e-5e7303c12fd3 req-a704756a-8958-44e6-9822-9889d15e365c service nova] Creating event network-vif-plugged:0a218b4e-3337-4b9d-9226-b484077f2606 for instance 7d2bee05-65c9-445a-a7ca-98808614d991 on hv-cinder-82786 Feb 09 13:11:53.095609 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-8ae8db01-bf46-4008-806e-5e7303c12fd3 req-a704756a-8958-44e6-9822-9889d15e365c service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038105 Feb 09 13:11:53.096226 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 52/115] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:11:53.243421 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-38116ab6-bb04-413a-afe0-86cc8e2059f6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:53.244031 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-38116ab6-bb04-413a-afe0-86cc8e2059f6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:53.253686 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-38116ab6-bb04-413a-afe0-86cc8e2059f6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:53.256023 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-38116ab6-bb04-413a-afe0-86cc8e2059f6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:53.257455 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-38116ab6-bb04-413a-afe0-86cc8e2059f6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:53.263339 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-38116ab6-bb04-413a-afe0-86cc8e2059f6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:53.294091 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-aac4f567-b75a-464e-b136-d53bc67b2d68 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:53.294827 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-aac4f567-b75a-464e-b136-d53bc67b2d68 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:53.301165 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-aac4f567-b75a-464e-b136-d53bc67b2d68 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:53.301771 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-aac4f567-b75a-464e-b136-d53bc67b2d68 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:53.303216 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-aac4f567-b75a-464e-b136-d53bc67b2d68 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:53.303663 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-aac4f567-b75a-464e-b136-d53bc67b2d68 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:53.555548 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-aac4f567-b75a-464e-b136-d53bc67b2d68 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:53.563502 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-aac4f567-b75a-464e-b136-d53bc67b2d68 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1506 microversion: 2.1 time: 0.273277 Feb 09 13:11:53.564106 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 53/116] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:53 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1506 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:53.579434 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-b78b3d99-4e01-4328-bae2-499936a2deb1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:53.580054 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-b78b3d99-4e01-4328-bae2-499936a2deb1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:53.594296 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b78b3d99-4e01-4328-bae2-499936a2deb1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:53.602601 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b78b3d99-4e01-4328-bae2-499936a2deb1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:53.604740 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b78b3d99-4e01-4328-bae2-499936a2deb1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:53.605476 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b78b3d99-4e01-4328-bae2-499936a2deb1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:53.620572 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-38116ab6-bb04-413a-afe0-86cc8e2059f6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:53.629555 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-38116ab6-bb04-413a-afe0-86cc8e2059f6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1322 microversion: 2.1 time: 0.390453 Feb 09 13:11:53.630319 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 64/117] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:53 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:53.644962 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-8f1c5d00-f6e6-4c41-b1ab-ed5f92085aaa tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:53.645841 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-8f1c5d00-f6e6-4c41-b1ab-ed5f92085aaa tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:53.665964 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8f1c5d00-f6e6-4c41-b1ab-ed5f92085aaa tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:53.666430 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8f1c5d00-f6e6-4c41-b1ab-ed5f92085aaa tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:53.667276 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8f1c5d00-f6e6-4c41-b1ab-ed5f92085aaa tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:53.667877 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8f1c5d00-f6e6-4c41-b1ab-ed5f92085aaa tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:53.784415 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-b78b3d99-4e01-4328-bae2-499936a2deb1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:53.792397 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-b78b3d99-4e01-4328-bae2-499936a2deb1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1364 microversion: 2.1 time: 0.226973 Feb 09 13:11:53.793264 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 54/118] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:53 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:53.823045 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-8f1c5d00-f6e6-4c41-b1ab-ed5f92085aaa tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:53.830304 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-8f1c5d00-f6e6-4c41-b1ab-ed5f92085aaa tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b" status: 200 len: 1313 microversion: 2.1 time: 0.196492 Feb 09 13:11:53.830838 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 65/119] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:53 2022] GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:54.647620 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-0df62708-5a06-4f5a-8575-86154919fa55 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:54.648416 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-0df62708-5a06-4f5a-8575-86154919fa55 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:54.654758 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0df62708-5a06-4f5a-8575-86154919fa55 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:54.655276 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0df62708-5a06-4f5a-8575-86154919fa55 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:54.656069 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0df62708-5a06-4f5a-8575-86154919fa55 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:54.656506 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0df62708-5a06-4f5a-8575-86154919fa55 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:54.794300 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-0df62708-5a06-4f5a-8575-86154919fa55 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:54.802589 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-0df62708-5a06-4f5a-8575-86154919fa55 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1322 microversion: 2.1 time: 0.160198 Feb 09 13:11:54.803363 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 55/120] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:54 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:54.810388 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-840c911e-bf8c-499e-bf09-329947aa2709 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:54.811028 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-840c911e-bf8c-499e-bf09-329947aa2709 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:54.832500 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-840c911e-bf8c-499e-bf09-329947aa2709 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:54.834254 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-840c911e-bf8c-499e-bf09-329947aa2709 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:54.835245 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-840c911e-bf8c-499e-bf09-329947aa2709 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:54.835675 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-840c911e-bf8c-499e-bf09-329947aa2709 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:54.848833 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c5f72748-2ef1-4a52-894a-edb577508a36 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:54.849447 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-c5f72748-2ef1-4a52-894a-edb577508a36 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:54.856582 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c5f72748-2ef1-4a52-894a-edb577508a36 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:54.857037 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c5f72748-2ef1-4a52-894a-edb577508a36 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:54.857842 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c5f72748-2ef1-4a52-894a-edb577508a36 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:54.858355 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c5f72748-2ef1-4a52-894a-edb577508a36 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:54.991085 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-840c911e-bf8c-499e-bf09-329947aa2709 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:54.999464 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-840c911e-bf8c-499e-bf09-329947aa2709 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1364 microversion: 2.1 time: 0.193251 Feb 09 13:11:55.000103 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 66/121] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:54 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:55.110778 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-f82517b7-ddf4-4156-8b52-4571398c8494 req-df2bb87e-1e70-40d6-9544-7f14877ef232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f002ff5-5d1f-4467-95ed-59f40d89a99d", "name": "network-vif-plugged", "status": "completed", "tag": "f0f66d6e-dac2-4b65-a7f0-da58e82e9c63"}, {"server_uuid": "a679ac91-50c0-4efc-ae25-c630fd14986b", "name": "network-vif-plugged", "status": "completed", "tag": "98fadb8e-f344-43c4-a8db-ee5bc28b5134"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:11:55.112587 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:11:55.112587 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:11:55.133761 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-f82517b7-ddf4-4156-8b52-4571398c8494 req-df2bb87e-1e70-40d6-9544-7f14877ef232 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:55.134223 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-f82517b7-ddf4-4156-8b52-4571398c8494 req-df2bb87e-1e70-40d6-9544-7f14877ef232 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:55.160206 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-f82517b7-ddf4-4156-8b52-4571398c8494 req-df2bb87e-1e70-40d6-9544-7f14877ef232 service nova] Creating event network-vif-plugged:f0f66d6e-dac2-4b65-a7f0-da58e82e9c63 for instance 8f002ff5-5d1f-4467-95ed-59f40d89a99d on hv-cinder-82786 Feb 09 13:11:55.160778 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-f82517b7-ddf4-4156-8b52-4571398c8494 req-df2bb87e-1e70-40d6-9544-7f14877ef232 service nova] Creating event network-vif-plugged:98fadb8e-f344-43c4-a8db-ee5bc28b5134 for instance a679ac91-50c0-4efc-ae25-c630fd14986b on hv-cinder-82786 Feb 09 13:11:55.168200 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-f82517b7-ddf4-4156-8b52-4571398c8494 req-df2bb87e-1e70-40d6-9544-7f14877ef232 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.061279 Feb 09 13:11:55.168841 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 67/122] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:11:55.196889 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c5f72748-2ef1-4a52-894a-edb577508a36 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:55.206874 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c5f72748-2ef1-4a52-894a-edb577508a36 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b" status: 200 len: 1313 microversion: 2.1 time: 0.361546 Feb 09 13:11:55.207467 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 56/123] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:54 2022] GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:55.498542 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-9053133d-fe29-478d-8557-6ebcc55303c3 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77d032b8-b5d2-47be-b3cb-028fbe731fcd"}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:11:55.506275 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-9053133d-fe29-478d-8557-6ebcc55303c3 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:55.509669 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9053133d-fe29-478d-8557-6ebcc55303c3 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:55.511913 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9053133d-fe29-478d-8557-6ebcc55303c3 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:55.512770 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9053133d-fe29-478d-8557-6ebcc55303c3 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:55.513205 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9053133d-fe29-478d-8557-6ebcc55303c3 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:55.826842 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-7c6e8833-3ba1-4f40-8306-951903f3bbe1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:55.826842 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-7c6e8833-3ba1-4f40-8306-951903f3bbe1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:55.835620 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7c6e8833-3ba1-4f40-8306-951903f3bbe1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:55.836313 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7c6e8833-3ba1-4f40-8306-951903f3bbe1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:55.838135 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7c6e8833-3ba1-4f40-8306-951903f3bbe1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:55.839251 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7c6e8833-3ba1-4f40-8306-951903f3bbe1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:55.978504 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-7c6e8833-3ba1-4f40-8306-951903f3bbe1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:55.986242 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-7c6e8833-3ba1-4f40-8306-951903f3bbe1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1322 microversion: 2.1 time: 0.168203 Feb 09 13:11:55.987068 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 57/124] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:55 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:56.015875 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-2b671bc2-48b8-4e21-917b-8d3145718c50 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:56.019668 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-2b671bc2-48b8-4e21-917b-8d3145718c50 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:56.026084 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2b671bc2-48b8-4e21-917b-8d3145718c50 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:56.026543 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2b671bc2-48b8-4e21-917b-8d3145718c50 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:56.027361 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2b671bc2-48b8-4e21-917b-8d3145718c50 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:56.027805 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2b671bc2-48b8-4e21-917b-8d3145718c50 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:56.168406 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-2b671bc2-48b8-4e21-917b-8d3145718c50 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:56.176213 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-2b671bc2-48b8-4e21-917b-8d3145718c50 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1550 microversion: 2.1 time: 0.163922 Feb 09 13:11:56.176787 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 58/125] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:56 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1550 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:11:56.195945 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-a9d6e955-8313-464c-98a1-7f6afe4036a3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:56.196546 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-a9d6e955-8313-464c-98a1-7f6afe4036a3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:56.205359 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a9d6e955-8313-464c-98a1-7f6afe4036a3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:56.206353 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a9d6e955-8313-464c-98a1-7f6afe4036a3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:56.219692 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a9d6e955-8313-464c-98a1-7f6afe4036a3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:56.220969 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a9d6e955-8313-464c-98a1-7f6afe4036a3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:56.367707 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-a9d6e955-8313-464c-98a1-7f6afe4036a3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.173482 Feb 09 13:11:56.367707 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 59/126] 10.222.0.84 () {58 vars in 1274 bytes} [Wed Feb 9 13:11:56 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:11:56.372661 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-0aea8f84-2050-4c06-8a20-6160fccb2500 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:56.372779 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-0aea8f84-2050-4c06-8a20-6160fccb2500 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:56.381280 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0aea8f84-2050-4c06-8a20-6160fccb2500 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:56.381280 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0aea8f84-2050-4c06-8a20-6160fccb2500 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:56.381910 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0aea8f84-2050-4c06-8a20-6160fccb2500 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:56.382357 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0aea8f84-2050-4c06-8a20-6160fccb2500 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:56.557465 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-0aea8f84-2050-4c06-8a20-6160fccb2500 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:56.565422 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-0aea8f84-2050-4c06-8a20-6160fccb2500 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b" status: 200 len: 1313 microversion: 2.1 time: 0.197960 Feb 09 13:11:56.567034 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 60/127] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:56 2022] GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:56.795647 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ff541b61-aa2c-4cf6-8443-92bc6c5064ea tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e64beae9-0dc4-4cd0-aeec-11542eb6c28a"}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:11:56.796775 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-ff541b61-aa2c-4cf6-8443-92bc6c5064ea tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:56.803310 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ff541b61-aa2c-4cf6-8443-92bc6c5064ea tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:56.803439 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ff541b61-aa2c-4cf6-8443-92bc6c5064ea tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:56.804142 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ff541b61-aa2c-4cf6-8443-92bc6c5064ea tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:56.804578 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ff541b61-aa2c-4cf6-8443-92bc6c5064ea tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:56.923307 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-9053133d-fe29-478d-8557-6ebcc55303c3 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "POST /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.428440 Feb 09 13:11:56.924068 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 68/128] 10.222.0.84 () {60 vars in 1322 bytes} [Wed Feb 9 13:11:55 2022] POST /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736/os-volume_attachments => generated 194 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:11:57.012294 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-b94c0a29-e532-4e4d-9e5d-2d5e348a4657 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:57.012294 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-b94c0a29-e532-4e4d-9e5d-2d5e348a4657 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:57.016151 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b94c0a29-e532-4e4d-9e5d-2d5e348a4657 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:57.016698 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b94c0a29-e532-4e4d-9e5d-2d5e348a4657 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:57.017610 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b94c0a29-e532-4e4d-9e5d-2d5e348a4657 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:57.018118 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b94c0a29-e532-4e4d-9e5d-2d5e348a4657 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:57.366099 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-b94c0a29-e532-4e4d-9e5d-2d5e348a4657 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:57.373998 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-b94c0a29-e532-4e4d-9e5d-2d5e348a4657 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1322 microversion: 2.1 time: 0.372438 Feb 09 13:11:57.374606 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 69/129] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:57 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:57.587012 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-46cf8d43-399d-48e3-b4a5-9d799958a556 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:57.602910 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-46cf8d43-399d-48e3-b4a5-9d799958a556 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:57.616075 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-46cf8d43-399d-48e3-b4a5-9d799958a556 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:57.616754 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-46cf8d43-399d-48e3-b4a5-9d799958a556 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:57.618235 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-46cf8d43-399d-48e3-b4a5-9d799958a556 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:57.619036 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-46cf8d43-399d-48e3-b4a5-9d799958a556 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:57.785981 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-ff541b61-aa2c-4cf6-8443-92bc6c5064ea tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "POST /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.998434 Feb 09 13:11:57.786930 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 61/130] 10.222.0.84 () {60 vars in 1322 bytes} [Wed Feb 9 13:11:56 2022] POST /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f/os-volume_attachments => generated 194 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:11:57.873757 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-46cf8d43-399d-48e3-b4a5-9d799958a556 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:57.883768 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-46cf8d43-399d-48e3-b4a5-9d799958a556 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b" status: 200 len: 1313 microversion: 2.1 time: 0.304657 Feb 09 13:11:57.884414 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 70/131] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:57 2022] GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:58.092934 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-f2082fca-3e07-446e-b766-6eaa1e394bad req-e0830611-451b-4fcf-a692-5eec4c3b1332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d2bee05-65c9-445a-a7ca-98808614d991", "tag": "0a218b4e-3337-4b9d-9226-b484077f2606"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:11:58.094529 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:11:58.094529 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:11:58.098537 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-a900a316-1ecb-4bb2-bf07-6d5fc7a30a4c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:58.099145 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-a900a316-1ecb-4bb2-bf07-6d5fc7a30a4c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:58.110402 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a900a316-1ecb-4bb2-bf07-6d5fc7a30a4c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:58.115662 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-f2082fca-3e07-446e-b766-6eaa1e394bad req-e0830611-451b-4fcf-a692-5eec4c3b1332 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:58.121330 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-f2082fca-3e07-446e-b766-6eaa1e394bad req-e0830611-451b-4fcf-a692-5eec4c3b1332 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:58.121459 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a900a316-1ecb-4bb2-bf07-6d5fc7a30a4c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:58.121459 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a900a316-1ecb-4bb2-bf07-6d5fc7a30a4c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:58.121459 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a900a316-1ecb-4bb2-bf07-6d5fc7a30a4c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:58.133255 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-f2082fca-3e07-446e-b766-6eaa1e394bad req-e0830611-451b-4fcf-a692-5eec4c3b1332 service nova] Creating event network-changed:0a218b4e-3337-4b9d-9226-b484077f2606 for instance 7d2bee05-65c9-445a-a7ca-98808614d991 on hv-cinder-82786 Feb 09 13:11:58.143801 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-f2082fca-3e07-446e-b766-6eaa1e394bad req-e0830611-451b-4fcf-a692-5eec4c3b1332 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054282 Feb 09 13:11:58.153404 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 71/132] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:11:58.393295 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-3aa091ad-f1f0-40ad-be2c-07512fb94099 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:58.394446 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-3aa091ad-f1f0-40ad-be2c-07512fb94099 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:58.403762 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3aa091ad-f1f0-40ad-be2c-07512fb94099 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:58.404438 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3aa091ad-f1f0-40ad-be2c-07512fb94099 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:58.405483 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3aa091ad-f1f0-40ad-be2c-07512fb94099 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:58.406103 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3aa091ad-f1f0-40ad-be2c-07512fb94099 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:58.572141 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-a900a316-1ecb-4bb2-bf07-6d5fc7a30a4c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:58.579756 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-a900a316-1ecb-4bb2-bf07-6d5fc7a30a4c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1550 microversion: 2.1 time: 0.494697 Feb 09 13:11:58.587215 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-3aa091ad-f1f0-40ad-be2c-07512fb94099 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:58.590215 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 62/133] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:58 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1550 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:58.615027 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-3aa091ad-f1f0-40ad-be2c-07512fb94099 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1514 microversion: 2.1 time: 0.226178 Feb 09 13:11:58.618057 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 72/134] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:58 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1514 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:58.638108 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-6f3e5174-fd2c-4c29-aa66-1b3c4a4a5908 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:11:58.640055 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-6f3e5174-fd2c-4c29-aa66-1b3c4a4a5908 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:58.647079 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6f3e5174-fd2c-4c29-aa66-1b3c4a4a5908 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:58.670762 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6f3e5174-fd2c-4c29-aa66-1b3c4a4a5908 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:58.670762 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6f3e5174-fd2c-4c29-aa66-1b3c4a4a5908 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:58.670762 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6f3e5174-fd2c-4c29-aa66-1b3c4a4a5908 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:58.674071 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.objects.instance [None req-6f3e5174-fd2c-4c29-aa66-1b3c4a4a5908 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lazy-loading 'flavor' on Instance uuid 8f002ff5-5d1f-4467-95ed-59f40d89a99d {{(pid=116749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:11:58.903064 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-21cdba7a-2707-489a-a28b-4db50d347081 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:58.904200 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-21cdba7a-2707-489a-a28b-4db50d347081 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:58.912704 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-21cdba7a-2707-489a-a28b-4db50d347081 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:58.913529 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-21cdba7a-2707-489a-a28b-4db50d347081 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:58.914623 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-21cdba7a-2707-489a-a28b-4db50d347081 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:58.915225 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-21cdba7a-2707-489a-a28b-4db50d347081 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:59.021889 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-6f3e5174-fd2c-4c29-aa66-1b3c4a4a5908 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "POST /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d/action" status: 200 len: 32 microversion: 2.1 time: 0.391077 Feb 09 13:11:59.029430 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 63/135] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Feb 9 13:11:58 2022] POST /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d/action => generated 32 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 09 13:11:59.035670 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-6176616e-26dc-4dbb-ad19-fbaa2f8f907f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:59.036676 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-6176616e-26dc-4dbb-ad19-fbaa2f8f907f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:59.050742 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6176616e-26dc-4dbb-ad19-fbaa2f8f907f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:59.051423 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6176616e-26dc-4dbb-ad19-fbaa2f8f907f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:59.052311 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6176616e-26dc-4dbb-ad19-fbaa2f8f907f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:59.052833 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6176616e-26dc-4dbb-ad19-fbaa2f8f907f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:59.111000 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-21cdba7a-2707-489a-a28b-4db50d347081 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:59.118877 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-21cdba7a-2707-489a-a28b-4db50d347081 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b" status: 200 len: 1497 microversion: 2.1 time: 0.221040 Feb 09 13:11:59.120107 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 73/136] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:58 2022] GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b => generated 1497 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:59.264922 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6176616e-26dc-4dbb-ad19-fbaa2f8f907f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:59.272383 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-6176616e-26dc-4dbb-ad19-fbaa2f8f907f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.241081 Feb 09 13:11:59.273115 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 64/137] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:59 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:59.598461 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-6a6f6b6b-cd46-480e-827d-9518c812a476 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:59.599185 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-6a6f6b6b-cd46-480e-827d-9518c812a476 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:59.605874 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6a6f6b6b-cd46-480e-827d-9518c812a476 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:59.606317 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6a6f6b6b-cd46-480e-827d-9518c812a476 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:59.607132 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6a6f6b6b-cd46-480e-827d-9518c812a476 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:59.607751 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6a6f6b6b-cd46-480e-827d-9518c812a476 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:59.817904 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6a6f6b6b-cd46-480e-827d-9518c812a476 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:11:59.829086 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-6a6f6b6b-cd46-480e-827d-9518c812a476 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1669 microversion: 2.1 time: 0.235391 Feb 09 13:11:59.829747 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 74/138] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:11:59 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1669 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:11:59.847378 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-bf095345-4ba0-4303-b15a-f05621833716 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:11:59.848160 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-bf095345-4ba0-4303-b15a-f05621833716 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:11:59.855058 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bf095345-4ba0-4303-b15a-f05621833716 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:59.855306 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bf095345-4ba0-4303-b15a-f05621833716 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:59.856278 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bf095345-4ba0-4303-b15a-f05621833716 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:11:59.856720 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bf095345-4ba0-4303-b15a-f05621833716 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:11:59.883478 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-bf095345-4ba0-4303-b15a-f05621833716 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991/ips" status: 200 len: 146 microversion: 2.1 time: 0.041555 Feb 09 13:11:59.884233 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 65/139] 10.222.0.84 () {58 vars in 1247 bytes} [Wed Feb 9 13:11:59 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:12:00.262039 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-e7a0d4f2-283b-4ad8-9f46-f01b7ba022de tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:00.262873 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-e7a0d4f2-283b-4ad8-9f46-f01b7ba022de tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:00.268991 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e7a0d4f2-283b-4ad8-9f46-f01b7ba022de tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:00.269449 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e7a0d4f2-283b-4ad8-9f46-f01b7ba022de tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:00.270248 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e7a0d4f2-283b-4ad8-9f46-f01b7ba022de tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:00.270777 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e7a0d4f2-283b-4ad8-9f46-f01b7ba022de tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:00.290162 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-e1509855-7f76-48e9-b45b-e0d1eebe6388 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:00.290968 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-e1509855-7f76-48e9-b45b-e0d1eebe6388 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:00.297811 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-e7a0d4f2-283b-4ad8-9f46-f01b7ba022de tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Going to try to terminate instance {{(pid=116748) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 09 13:12:00.298297 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e1509855-7f76-48e9-b45b-e0d1eebe6388 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:00.299265 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e1509855-7f76-48e9-b45b-e0d1eebe6388 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:00.300305 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e1509855-7f76-48e9-b45b-e0d1eebe6388 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:00.301589 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e1509855-7f76-48e9-b45b-e0d1eebe6388 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:00.444220 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-e1509855-7f76-48e9-b45b-e0d1eebe6388 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:00.451521 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-e1509855-7f76-48e9-b45b-e0d1eebe6388 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.165950 Feb 09 13:12:00.454242 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 66/140] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:00 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:00.677036 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-e7a0d4f2-283b-4ad8-9f46-f01b7ba022de tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "DELETE /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b" status: 204 len: 0 microversion: 2.1 time: 0.422760 Feb 09 13:12:00.677619 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 75/141] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:12:00 2022] DELETE /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 09 13:12:00.690142 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-52aa288d-a84c-4cbc-9a54-d7ced665e61b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:00.690142 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-52aa288d-a84c-4cbc-9a54-d7ced665e61b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:00.692471 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-52aa288d-a84c-4cbc-9a54-d7ced665e61b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:00.692957 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-52aa288d-a84c-4cbc-9a54-d7ced665e61b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:00.693777 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-52aa288d-a84c-4cbc-9a54-d7ced665e61b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:00.694228 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-52aa288d-a84c-4cbc-9a54-d7ced665e61b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:00.845445 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-52aa288d-a84c-4cbc-9a54-d7ced665e61b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:00.853764 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-52aa288d-a84c-4cbc-9a54-d7ced665e61b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b" status: 200 len: 1503 microversion: 2.1 time: 0.171899 Feb 09 13:12:00.854346 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 67/142] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:00 2022] GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:01.469865 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-cae56f99-e03c-4ce0-bffc-cd7d24662f59 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:01.470712 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-cae56f99-e03c-4ce0-bffc-cd7d24662f59 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:01.477678 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cae56f99-e03c-4ce0-bffc-cd7d24662f59 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:01.478278 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cae56f99-e03c-4ce0-bffc-cd7d24662f59 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:01.479158 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cae56f99-e03c-4ce0-bffc-cd7d24662f59 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:01.479751 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cae56f99-e03c-4ce0-bffc-cd7d24662f59 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:01.614187 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-cae56f99-e03c-4ce0-bffc-cd7d24662f59 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:01.623146 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-cae56f99-e03c-4ce0-bffc-cd7d24662f59 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.157365 Feb 09 13:12:01.624369 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 76/143] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:01 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:01.871202 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-860ab6e3-8cf7-40ed-93fd-05830cb44135 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:01.871714 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-860ab6e3-8cf7-40ed-93fd-05830cb44135 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:01.877965 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-860ab6e3-8cf7-40ed-93fd-05830cb44135 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:01.878422 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-860ab6e3-8cf7-40ed-93fd-05830cb44135 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:01.879231 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-860ab6e3-8cf7-40ed-93fd-05830cb44135 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:01.882659 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-860ab6e3-8cf7-40ed-93fd-05830cb44135 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:02.022040 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-860ab6e3-8cf7-40ed-93fd-05830cb44135 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:02.030653 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-860ab6e3-8cf7-40ed-93fd-05830cb44135 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b" status: 200 len: 1503 microversion: 2.1 time: 0.163642 Feb 09 13:12:02.033661 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 68/144] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:01 2022] GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:02.641723 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-2759403e-5844-4003-910b-57073e02c3bf tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:02.642764 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-2759403e-5844-4003-910b-57073e02c3bf tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:02.650437 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2759403e-5844-4003-910b-57073e02c3bf tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:02.650938 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2759403e-5844-4003-910b-57073e02c3bf tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:02.651737 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2759403e-5844-4003-910b-57073e02c3bf tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:02.652178 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2759403e-5844-4003-910b-57073e02c3bf tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:02.792095 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-2759403e-5844-4003-910b-57073e02c3bf tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:02.799670 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-2759403e-5844-4003-910b-57073e02c3bf tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.162203 Feb 09 13:12:02.800250 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 77/145] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:02 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:03.048488 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ec6368f3-e788-4227-8237-e9d6df624e88 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:03.049683 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-ec6368f3-e788-4227-8237-e9d6df624e88 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:03.056602 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ec6368f3-e788-4227-8237-e9d6df624e88 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:03.057096 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ec6368f3-e788-4227-8237-e9d6df624e88 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:03.057892 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ec6368f3-e788-4227-8237-e9d6df624e88 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:03.058326 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ec6368f3-e788-4227-8237-e9d6df624e88 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:03.371230 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ec6368f3-e788-4227-8237-e9d6df624e88 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:03.380554 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-ec6368f3-e788-4227-8237-e9d6df624e88 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b" status: 200 len: 1503 microversion: 2.1 time: 0.335866 Feb 09 13:12:03.390528 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 69/146] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:03 2022] GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b => generated 1503 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:03.720494 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-a6a28782-a3ef-4ad7-8cf6-ec05088b9658 req-ba3a5cd4-4587-4010-80a8-a6fce2429a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a679ac91-50c0-4efc-ae25-c630fd14986b", "name": "network-vif-deleted", "tag": "98fadb8e-f344-43c4-a8db-ee5bc28b5134"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:12:03.722978 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:12:03.722978 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:12:03.731039 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-a6a28782-a3ef-4ad7-8cf6-ec05088b9658 req-ba3a5cd4-4587-4010-80a8-a6fce2429a40 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:03.731548 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-a6a28782-a3ef-4ad7-8cf6-ec05088b9658 req-ba3a5cd4-4587-4010-80a8-a6fce2429a40 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:03.743467 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-a6a28782-a3ef-4ad7-8cf6-ec05088b9658 req-ba3a5cd4-4587-4010-80a8-a6fce2429a40 service nova] Creating event network-vif-deleted:98fadb8e-f344-43c4-a8db-ee5bc28b5134 for instance a679ac91-50c0-4efc-ae25-c630fd14986b on hv-cinder-82786 Feb 09 13:12:03.748567 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-a6a28782-a3ef-4ad7-8cf6-ec05088b9658 req-ba3a5cd4-4587-4010-80a8-a6fce2429a40 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031614 Feb 09 13:12:03.749154 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 78/147] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:12:03.817060 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-b07acbd7-832d-4f43-a739-dfc346c4f51b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:03.817781 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-b07acbd7-832d-4f43-a739-dfc346c4f51b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:03.824356 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b07acbd7-832d-4f43-a739-dfc346c4f51b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:03.825449 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b07acbd7-832d-4f43-a739-dfc346c4f51b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:03.826474 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b07acbd7-832d-4f43-a739-dfc346c4f51b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:03.827333 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b07acbd7-832d-4f43-a739-dfc346c4f51b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:03.976346 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-b07acbd7-832d-4f43-a739-dfc346c4f51b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:03.984611 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-b07acbd7-832d-4f43-a739-dfc346c4f51b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.171235 Feb 09 13:12:03.985183 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 70/148] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:03 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:04.397974 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-991b97f7-7b98-4353-914a-275bf2dd9c6a tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:04.399431 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-991b97f7-7b98-4353-914a-275bf2dd9c6a tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:04.405925 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-991b97f7-7b98-4353-914a-275bf2dd9c6a tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:04.411413 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-991b97f7-7b98-4353-914a-275bf2dd9c6a tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:04.411413 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-991b97f7-7b98-4353-914a-275bf2dd9c6a tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:04.411413 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-991b97f7-7b98-4353-914a-275bf2dd9c6a tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:04.440074 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-991b97f7-7b98-4353-914a-275bf2dd9c6a tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:04.440720 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-991b97f7-7b98-4353-914a-275bf2dd9c6a tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:04.441192 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-991b97f7-7b98-4353-914a-275bf2dd9c6a tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lazy-loading 'fault' on Instance uuid a679ac91-50c0-4efc-ae25-c630fd14986b {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:12:04.488004 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-991b97f7-7b98-4353-914a-275bf2dd9c6a tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:04.495524 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-991b97f7-7b98-4353-914a-275bf2dd9c6a tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b" status: 200 len: 1303 microversion: 2.1 time: 0.102042 Feb 09 13:12:04.496205 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 79/149] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:04 2022] GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:05.001889 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-2ae30540-814f-4eb0-a495-c8da778de305 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:05.002609 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-2ae30540-814f-4eb0-a495-c8da778de305 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:05.008818 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2ae30540-814f-4eb0-a495-c8da778de305 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:05.009269 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2ae30540-814f-4eb0-a495-c8da778de305 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:05.010052 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2ae30540-814f-4eb0-a495-c8da778de305 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:05.010481 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2ae30540-814f-4eb0-a495-c8da778de305 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:05.157497 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-2ae30540-814f-4eb0-a495-c8da778de305 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:05.165309 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-2ae30540-814f-4eb0-a495-c8da778de305 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.167443 Feb 09 13:12:05.166641 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 71/150] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:04 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:05.518354 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-aa9424b5-eea5-4c80-933d-39956f6be3af tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:05.519107 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-aa9424b5-eea5-4c80-933d-39956f6be3af tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:05.526119 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-aa9424b5-eea5-4c80-933d-39956f6be3af tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:05.526584 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-aa9424b5-eea5-4c80-933d-39956f6be3af tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:05.527378 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-aa9424b5-eea5-4c80-933d-39956f6be3af tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:05.527815 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-aa9424b5-eea5-4c80-933d-39956f6be3af tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:05.568212 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-aa9424b5-eea5-4c80-933d-39956f6be3af tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:05.568699 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-aa9424b5-eea5-4c80-933d-39956f6be3af tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:05.569173 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-aa9424b5-eea5-4c80-933d-39956f6be3af tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lazy-loading 'fault' on Instance uuid a679ac91-50c0-4efc-ae25-c630fd14986b {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:12:05.623024 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-aa9424b5-eea5-4c80-933d-39956f6be3af tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:05.633598 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-aa9424b5-eea5-4c80-933d-39956f6be3af tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b" status: 200 len: 1303 microversion: 2.1 time: 0.115809 Feb 09 13:12:05.633598 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 80/151] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:05 2022] GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b => generated 1303 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:06.185949 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-e3060bd3-bba1-4514-b7b4-9d139a8cc046 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:06.185949 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-e3060bd3-bba1-4514-b7b4-9d139a8cc046 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:06.190709 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e3060bd3-bba1-4514-b7b4-9d139a8cc046 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:06.191227 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e3060bd3-bba1-4514-b7b4-9d139a8cc046 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:06.192180 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e3060bd3-bba1-4514-b7b4-9d139a8cc046 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:06.192646 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e3060bd3-bba1-4514-b7b4-9d139a8cc046 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:06.338655 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-e3060bd3-bba1-4514-b7b4-9d139a8cc046 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:06.346139 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-e3060bd3-bba1-4514-b7b4-9d139a8cc046 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.167722 Feb 09 13:12:06.347307 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 72/152] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:06 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:06.649403 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-a8ad99b4-d09d-4df6-b2dc-f68624e4f7e7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:06.650013 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-a8ad99b4-d09d-4df6-b2dc-f68624e4f7e7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:06.657132 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a8ad99b4-d09d-4df6-b2dc-f68624e4f7e7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:06.657662 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a8ad99b4-d09d-4df6-b2dc-f68624e4f7e7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:06.658480 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a8ad99b4-d09d-4df6-b2dc-f68624e4f7e7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:06.659192 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a8ad99b4-d09d-4df6-b2dc-f68624e4f7e7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:06.690369 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a8ad99b4-d09d-4df6-b2dc-f68624e4f7e7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:06.690774 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a8ad99b4-d09d-4df6-b2dc-f68624e4f7e7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:06.691225 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-a8ad99b4-d09d-4df6-b2dc-f68624e4f7e7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lazy-loading 'fault' on Instance uuid a679ac91-50c0-4efc-ae25-c630fd14986b {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:12:06.731092 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a8ad99b4-d09d-4df6-b2dc-f68624e4f7e7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:06.738453 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-a8ad99b4-d09d-4df6-b2dc-f68624e4f7e7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b" status: 200 len: 1303 microversion: 2.1 time: 0.093079 Feb 09 13:12:06.739089 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 81/153] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:06 2022] GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:07.363594 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-953998e0-d1ab-421c-95cf-11d807d72b53 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:07.364229 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-953998e0-d1ab-421c-95cf-11d807d72b53 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:07.371620 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-953998e0-d1ab-421c-95cf-11d807d72b53 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:07.376337 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-953998e0-d1ab-421c-95cf-11d807d72b53 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:07.376337 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-953998e0-d1ab-421c-95cf-11d807d72b53 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:07.376337 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-953998e0-d1ab-421c-95cf-11d807d72b53 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:07.520497 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-953998e0-d1ab-421c-95cf-11d807d72b53 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:07.529603 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-953998e0-d1ab-421c-95cf-11d807d72b53 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.170040 Feb 09 13:12:07.535156 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 73/154] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:07 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:07.755535 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-fe2d19a6-5a35-461f-9b02-3a406d1e2a6f tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:07.756138 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-fe2d19a6-5a35-461f-9b02-3a406d1e2a6f tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:07.762814 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fe2d19a6-5a35-461f-9b02-3a406d1e2a6f tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:07.763263 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fe2d19a6-5a35-461f-9b02-3a406d1e2a6f tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:07.764044 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fe2d19a6-5a35-461f-9b02-3a406d1e2a6f tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:07.764476 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fe2d19a6-5a35-461f-9b02-3a406d1e2a6f tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:07.795513 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fe2d19a6-5a35-461f-9b02-3a406d1e2a6f tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:07.795983 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fe2d19a6-5a35-461f-9b02-3a406d1e2a6f tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:07.796432 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-fe2d19a6-5a35-461f-9b02-3a406d1e2a6f tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lazy-loading 'fault' on Instance uuid a679ac91-50c0-4efc-ae25-c630fd14986b {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:12:07.837746 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-fe2d19a6-5a35-461f-9b02-3a406d1e2a6f tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:07.845134 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-fe2d19a6-5a35-461f-9b02-3a406d1e2a6f tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b" status: 200 len: 1303 microversion: 2.1 time: 0.093197 Feb 09 13:12:07.845709 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 82/155] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:07 2022] GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:08.552090 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-971d4f16-0f9b-4d90-b4f7-508c8efcbdae tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:08.552768 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-971d4f16-0f9b-4d90-b4f7-508c8efcbdae tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:08.559581 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-971d4f16-0f9b-4d90-b4f7-508c8efcbdae tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:08.560031 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-971d4f16-0f9b-4d90-b4f7-508c8efcbdae tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:08.560986 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-971d4f16-0f9b-4d90-b4f7-508c8efcbdae tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:08.561420 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-971d4f16-0f9b-4d90-b4f7-508c8efcbdae tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:08.725899 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-971d4f16-0f9b-4d90-b4f7-508c8efcbdae tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:08.734575 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-971d4f16-0f9b-4d90-b4f7-508c8efcbdae tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.187248 Feb 09 13:12:08.735272 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 74/156] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:08 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:08.861839 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-6f8c54b4-7e9e-4a9d-b452-c3d543afbd8d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:08.862711 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-6f8c54b4-7e9e-4a9d-b452-c3d543afbd8d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: a679ac91-50c0-4efc-ae25-c630fd14986b] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:08.869629 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6f8c54b4-7e9e-4a9d-b452-c3d543afbd8d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:08.870083 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6f8c54b4-7e9e-4a9d-b452-c3d543afbd8d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:08.870902 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6f8c54b4-7e9e-4a9d-b452-c3d543afbd8d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:08.871342 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6f8c54b4-7e9e-4a9d-b452-c3d543afbd8d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:08.884320 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.wsgi [None req-6f8c54b4-7e9e-4a9d-b452-c3d543afbd8d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] HTTP exception thrown: Instance a679ac91-50c0-4efc-ae25-c630fd14986b could not be found. Feb 09 13:12:08.884907 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-6f8c54b4-7e9e-4a9d-b452-c3d543afbd8d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Returning 404 to user: Instance a679ac91-50c0-4efc-ae25-c630fd14986b could not be found. {{(pid=116748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:12:08.885721 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-6f8c54b4-7e9e-4a9d-b452-c3d543afbd8d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b" status: 404 len: 111 microversion: 2.1 time: 0.027616 Feb 09 13:12:08.886260 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 83/157] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:08 2022] GET /compute/v2.1/servers/a679ac91-50c0-4efc-ae25-c630fd14986b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:12:08.983866 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-f47df225-09c1-4568-8fbf-85e720ffe870 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1428179236", "imageRef": "af86cedd-e7d5-4a28-a810-f47830f4bffc", "flavorRef": "452", "networks": [{"uuid": "c14db480-376e-432e-bb98-3ed4db923bdb"}]}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:12:09.034274 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.network.neutron [None req-f47df225-09c1-4568-8fbf-85e720ffe870 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] validate_networks() for [('c14db480-376e-432e-bb98-3ed4db923bdb', None, None, None, None, None)] {{(pid=116749) validate_networks /opt/stack/nova/nova/network/neutron.py:2554}} Feb 09 13:12:09.384529 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-f47df225-09c1-4568-8fbf-85e720ffe870 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Flavor limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 09 13:12:09.384973 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-f47df225-09c1-4568-8fbf-85e720ffe870 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Image limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 09 13:12:09.385482 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-f47df225-09c1-4568-8fbf-85e720ffe870 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Flavor pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 09 13:12:09.385887 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-f47df225-09c1-4568-8fbf-85e720ffe870 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Image pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 09 13:12:09.386298 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-f47df225-09c1-4568-8fbf-85e720ffe870 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 09 13:12:09.394935 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f47df225-09c1-4568-8fbf-85e720ffe870 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:09.395403 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f47df225-09c1-4568-8fbf-85e720ffe870 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:09.396209 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f47df225-09c1-4568-8fbf-85e720ffe870 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:09.396752 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f47df225-09c1-4568-8fbf-85e720ffe870 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:09.415830 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-f47df225-09c1-4568-8fbf-85e720ffe870 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Getting quotas for project 989aed5dea7448f6aff599d6744ccec0. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:12:09.419786 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-f47df225-09c1-4568-8fbf-85e720ffe870 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Getting quotas for user 99cec126a43b4dc2b0f18af629b718ac and project 989aed5dea7448f6aff599d6744ccec0. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:12:09.431017 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-f47df225-09c1-4568-8fbf-85e720ffe870 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Going to run 1 instances... {{(pid=116749) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 09 13:12:09.433498 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-f47df225-09c1-4568-8fbf-85e720ffe870 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af86cedd-e7d5-4a28-a810-f47830f4bffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 09 13:12:09.577460 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-f47df225-09c1-4568-8fbf-85e720ffe870 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597702 Feb 09 13:12:09.578099 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 75/158] 10.222.0.84 () {60 vars in 1146 bytes} [Wed Feb 9 13:12:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 09 13:12:09.588891 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-e307bdb8-f71e-4d81-8b1c-0a9c1e54162b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:09.589430 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-e307bdb8-f71e-4d81-8b1c-0a9c1e54162b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:09.676380 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e307bdb8-f71e-4d81-8b1c-0a9c1e54162b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:09.684584 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-e307bdb8-f71e-4d81-8b1c-0a9c1e54162b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1214 microversion: 2.1 time: 0.100278 Feb 09 13:12:09.690615 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 84/159] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:09 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:09.751904 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-26d02568-53f8-4f51-be86-8a72a3eb9728 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:09.752527 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-26d02568-53f8-4f51-be86-8a72a3eb9728 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:09.759618 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-26d02568-53f8-4f51-be86-8a72a3eb9728 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:09.760174 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-26d02568-53f8-4f51-be86-8a72a3eb9728 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:09.765616 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-26d02568-53f8-4f51-be86-8a72a3eb9728 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:09.765616 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-26d02568-53f8-4f51-be86-8a72a3eb9728 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:09.900728 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-26d02568-53f8-4f51-be86-8a72a3eb9728 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:09.908203 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-26d02568-53f8-4f51-be86-8a72a3eb9728 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.160199 Feb 09 13:12:09.908856 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 76/160] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:09 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:10.704283 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-99586925-8e3a-40cd-bb98-4987a8d6c5be tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:10.705751 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-99586925-8e3a-40cd-bb98-4987a8d6c5be tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:10.717280 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-99586925-8e3a-40cd-bb98-4987a8d6c5be tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:10.717280 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-99586925-8e3a-40cd-bb98-4987a8d6c5be tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:10.717280 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-99586925-8e3a-40cd-bb98-4987a8d6c5be tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:10.717280 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-99586925-8e3a-40cd-bb98-4987a8d6c5be tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:10.786039 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-99586925-8e3a-40cd-bb98-4987a8d6c5be tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:10.798715 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-99586925-8e3a-40cd-bb98-4987a8d6c5be tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1218 microversion: 2.1 time: 0.098563 Feb 09 13:12:10.799504 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 85/161] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:10 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:10.925227 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d5d3d095-3dec-4d0d-b16b-dad441ba7d4c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:10.925765 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d5d3d095-3dec-4d0d-b16b-dad441ba7d4c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:10.932807 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d5d3d095-3dec-4d0d-b16b-dad441ba7d4c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:10.933258 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d5d3d095-3dec-4d0d-b16b-dad441ba7d4c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:10.934045 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d5d3d095-3dec-4d0d-b16b-dad441ba7d4c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:10.934512 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d5d3d095-3dec-4d0d-b16b-dad441ba7d4c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:11.099735 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-d5d3d095-3dec-4d0d-b16b-dad441ba7d4c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:11.107573 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d5d3d095-3dec-4d0d-b16b-dad441ba7d4c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.186074 Feb 09 13:12:11.108155 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 77/162] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:10 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:11.815807 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-694a4f61-e05e-4fe1-b0bb-c651358c0bab tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:11.816452 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-694a4f61-e05e-4fe1-b0bb-c651358c0bab tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:11.823352 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-694a4f61-e05e-4fe1-b0bb-c651358c0bab tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:11.823798 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-694a4f61-e05e-4fe1-b0bb-c651358c0bab tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:11.824577 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-694a4f61-e05e-4fe1-b0bb-c651358c0bab tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:11.825010 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-694a4f61-e05e-4fe1-b0bb-c651358c0bab tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:11.887554 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-694a4f61-e05e-4fe1-b0bb-c651358c0bab tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:11.894933 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-694a4f61-e05e-4fe1-b0bb-c651358c0bab tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1210 microversion: 2.1 time: 0.082703 Feb 09 13:12:11.895516 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 86/163] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:11 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:12.124080 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-e71a72d7-455d-41dc-9799-ba2456423dfe tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:12.124681 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-e71a72d7-455d-41dc-9799-ba2456423dfe tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:12.131101 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e71a72d7-455d-41dc-9799-ba2456423dfe tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:12.131543 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e71a72d7-455d-41dc-9799-ba2456423dfe tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:12.132331 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e71a72d7-455d-41dc-9799-ba2456423dfe tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:12.133438 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e71a72d7-455d-41dc-9799-ba2456423dfe tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:12.313755 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-e71a72d7-455d-41dc-9799-ba2456423dfe tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:12.322295 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-e71a72d7-455d-41dc-9799-ba2456423dfe tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.201908 Feb 09 13:12:12.322908 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 78/164] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:12 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:12.916782 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-05decb2a-620c-4a51-b887-12bcbc2bc0bf tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:12.918037 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-05decb2a-620c-4a51-b887-12bcbc2bc0bf tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:12.925002 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-05decb2a-620c-4a51-b887-12bcbc2bc0bf tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:12.925805 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-05decb2a-620c-4a51-b887-12bcbc2bc0bf tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:12.926350 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-05decb2a-620c-4a51-b887-12bcbc2bc0bf tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:12.926819 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-05decb2a-620c-4a51-b887-12bcbc2bc0bf tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:12.996497 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-05decb2a-620c-4a51-b887-12bcbc2bc0bf tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:13.003938 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-05decb2a-620c-4a51-b887-12bcbc2bc0bf tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1274 microversion: 2.1 time: 0.092009 Feb 09 13:12:13.006133 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 87/165] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:12 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1274 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:13.274508 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-84535a32-624c-4f39-a425-b6180f9447e4 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:13.275259 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-84535a32-624c-4f39-a425-b6180f9447e4 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:13.282112 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-84535a32-624c-4f39-a425-b6180f9447e4 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:13.283000 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-84535a32-624c-4f39-a425-b6180f9447e4 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:13.283930 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-84535a32-624c-4f39-a425-b6180f9447e4 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:13.284809 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-84535a32-624c-4f39-a425-b6180f9447e4 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:13.313580 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-84535a32-624c-4f39-a425-b6180f9447e4 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Going to try to terminate instance {{(pid=116749) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 09 13:12:13.339564 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-2c03df6c-2514-4fbb-9bee-149a7f76150d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:13.340438 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-2c03df6c-2514-4fbb-9bee-149a7f76150d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:13.347592 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2c03df6c-2514-4fbb-9bee-149a7f76150d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:13.348224 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2c03df6c-2514-4fbb-9bee-149a7f76150d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:13.350583 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2c03df6c-2514-4fbb-9bee-149a7f76150d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:13.350583 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2c03df6c-2514-4fbb-9bee-149a7f76150d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:13.509210 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-2c03df6c-2514-4fbb-9bee-149a7f76150d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:13.522037 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-2c03df6c-2514-4fbb-9bee-149a7f76150d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.186234 Feb 09 13:12:13.522975 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 88/166] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:13 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:13.684901 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-84535a32-624c-4f39-a425-b6180f9447e4 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "DELETE /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 204 len: 0 microversion: 2.1 time: 0.413581 Feb 09 13:12:13.685561 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 79/167] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:12:13 2022] DELETE /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 09 13:12:13.698056 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-526d5898-d7d7-4ec8-bf6f-57d007523f7b tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:13.698691 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-526d5898-d7d7-4ec8-bf6f-57d007523f7b tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:13.704951 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-526d5898-d7d7-4ec8-bf6f-57d007523f7b tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:13.705480 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-526d5898-d7d7-4ec8-bf6f-57d007523f7b tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:13.706278 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-526d5898-d7d7-4ec8-bf6f-57d007523f7b tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:13.706750 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-526d5898-d7d7-4ec8-bf6f-57d007523f7b tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:13.857266 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-526d5898-d7d7-4ec8-bf6f-57d007523f7b tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:13.871815 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-526d5898-d7d7-4ec8-bf6f-57d007523f7b tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1554 microversion: 2.1 time: 0.172546 Feb 09 13:12:13.871815 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 89/168] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:13 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:14.028391 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-6cdbf78e-6cfc-451a-9ce6-0a18fb6be3ea tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:14.029089 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-6cdbf78e-6cfc-451a-9ce6-0a18fb6be3ea tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:14.036223 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6cdbf78e-6cfc-451a-9ce6-0a18fb6be3ea tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:14.036802 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6cdbf78e-6cfc-451a-9ce6-0a18fb6be3ea tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:14.037619 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6cdbf78e-6cfc-451a-9ce6-0a18fb6be3ea tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:14.038065 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6cdbf78e-6cfc-451a-9ce6-0a18fb6be3ea tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:14.291534 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6cdbf78e-6cfc-451a-9ce6-0a18fb6be3ea tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:14.299753 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-6cdbf78e-6cfc-451a-9ce6-0a18fb6be3ea tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1314 microversion: 2.1 time: 0.276303 Feb 09 13:12:14.300471 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 80/169] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:14 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:14.539433 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-f4775cae-27ed-4e3b-929c-053e17bc7d8e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:14.540051 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-f4775cae-27ed-4e3b-929c-053e17bc7d8e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:14.546423 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f4775cae-27ed-4e3b-929c-053e17bc7d8e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:14.547229 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f4775cae-27ed-4e3b-929c-053e17bc7d8e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:14.548227 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f4775cae-27ed-4e3b-929c-053e17bc7d8e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:14.548887 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f4775cae-27ed-4e3b-929c-053e17bc7d8e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:14.701406 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f4775cae-27ed-4e3b-929c-053e17bc7d8e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:14.708910 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-f4775cae-27ed-4e3b-929c-053e17bc7d8e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.173355 Feb 09 13:12:14.709512 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 90/170] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:14 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:14.833031 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-2045c47d-ef78-4a63-88d1-04b5a7fadf29 req-a3e5fd7b-ecac-4ef3-938b-8d0a8116ad59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "362638ad-9f61-4ae2-87da-0627354c362c", "tag": "a0dc95c2-e8e7-465f-8598-f6cdc40e23e4"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:12:14.834962 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:12:14.834962 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:12:14.842209 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-2045c47d-ef78-4a63-88d1-04b5a7fadf29 req-a3e5fd7b-ecac-4ef3-938b-8d0a8116ad59 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:14.842780 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-2045c47d-ef78-4a63-88d1-04b5a7fadf29 req-a3e5fd7b-ecac-4ef3-938b-8d0a8116ad59 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:14.856890 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-2045c47d-ef78-4a63-88d1-04b5a7fadf29 req-a3e5fd7b-ecac-4ef3-938b-8d0a8116ad59 service nova] Creating event network-changed:a0dc95c2-e8e7-465f-8598-f6cdc40e23e4 for instance 362638ad-9f61-4ae2-87da-0627354c362c on hv-cinder-82786 Feb 09 13:12:14.861729 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-2045c47d-ef78-4a63-88d1-04b5a7fadf29 req-a3e5fd7b-ecac-4ef3-938b-8d0a8116ad59 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032221 Feb 09 13:12:14.862333 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 81/171] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:12:14.887036 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-a5853884-dd62-4361-848a-ddc49aba15c9 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:14.888089 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-a5853884-dd62-4361-848a-ddc49aba15c9 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:14.897604 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a5853884-dd62-4361-848a-ddc49aba15c9 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:14.900697 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a5853884-dd62-4361-848a-ddc49aba15c9 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:14.900697 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a5853884-dd62-4361-848a-ddc49aba15c9 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:14.900697 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a5853884-dd62-4361-848a-ddc49aba15c9 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:15.047278 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a5853884-dd62-4361-848a-ddc49aba15c9 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:15.055974 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-a5853884-dd62-4361-848a-ddc49aba15c9 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1554 microversion: 2.1 time: 0.174340 Feb 09 13:12:15.066258 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 91/172] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:14 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:15.316812 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-98e2451c-3338-4f10-86ef-96490620cf7d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:15.317433 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-98e2451c-3338-4f10-86ef-96490620cf7d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:15.324277 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-98e2451c-3338-4f10-86ef-96490620cf7d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:15.324733 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-98e2451c-3338-4f10-86ef-96490620cf7d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:15.325582 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-98e2451c-3338-4f10-86ef-96490620cf7d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:15.326029 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-98e2451c-3338-4f10-86ef-96490620cf7d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:15.733678 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-43bc0a39-b5e6-45b3-b2e8-eadc0b490b3a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:15.734292 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-43bc0a39-b5e6-45b3-b2e8-eadc0b490b3a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:15.740948 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-43bc0a39-b5e6-45b3-b2e8-eadc0b490b3a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:15.741740 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-43bc0a39-b5e6-45b3-b2e8-eadc0b490b3a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:15.742726 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-43bc0a39-b5e6-45b3-b2e8-eadc0b490b3a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:15.743230 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-43bc0a39-b5e6-45b3-b2e8-eadc0b490b3a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:15.746735 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-98e2451c-3338-4f10-86ef-96490620cf7d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:15.762404 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-98e2451c-3338-4f10-86ef-96490620cf7d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1314 microversion: 2.1 time: 0.448063 Feb 09 13:12:15.765547 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 82/173] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:15 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:15.899433 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-43bc0a39-b5e6-45b3-b2e8-eadc0b490b3a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:15.907147 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-43bc0a39-b5e6-45b3-b2e8-eadc0b490b3a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.185538 Feb 09 13:12:15.907959 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 92/174] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:15 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:16.072518 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-fe73f0c8-7c24-4df6-ad42-6513076f2140 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:16.073117 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-fe73f0c8-7c24-4df6-ad42-6513076f2140 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:16.079761 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-fe73f0c8-7c24-4df6-ad42-6513076f2140 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:16.080206 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-fe73f0c8-7c24-4df6-ad42-6513076f2140 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:16.080980 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-fe73f0c8-7c24-4df6-ad42-6513076f2140 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:16.081494 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-fe73f0c8-7c24-4df6-ad42-6513076f2140 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:16.251831 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-fe73f0c8-7c24-4df6-ad42-6513076f2140 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:16.267141 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-fe73f0c8-7c24-4df6-ad42-6513076f2140 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1554 microversion: 2.1 time: 0.198219 Feb 09 13:12:16.267653 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 83/175] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:16 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:16.782953 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-25518b79-dce6-45f9-a079-1be68d38771d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:16.783614 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-25518b79-dce6-45f9-a079-1be68d38771d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:16.790500 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-25518b79-dce6-45f9-a079-1be68d38771d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:16.791001 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-25518b79-dce6-45f9-a079-1be68d38771d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:16.791830 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-25518b79-dce6-45f9-a079-1be68d38771d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:16.792261 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-25518b79-dce6-45f9-a079-1be68d38771d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:16.877705 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-56bec68c-edd3-4be3-810c-3c086a5f17ff req-2caa0d90-5829-4b47-be41-4af65896010d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3449e9bb-2fd1-40a5-8003-d773c6d60736", "name": "network-vif-deleted", "tag": "65961941-2a92-4fd6-a368-cadf07ece780"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:12:16.879280 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:12:16.879280 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:12:16.893257 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-56bec68c-edd3-4be3-810c-3c086a5f17ff req-2caa0d90-5829-4b47-be41-4af65896010d service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:16.894347 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-56bec68c-edd3-4be3-810c-3c086a5f17ff req-2caa0d90-5829-4b47-be41-4af65896010d service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:16.915640 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-56bec68c-edd3-4be3-810c-3c086a5f17ff req-2caa0d90-5829-4b47-be41-4af65896010d service nova] Creating event network-vif-deleted:65961941-2a92-4fd6-a368-cadf07ece780 for instance 3449e9bb-2fd1-40a5-8003-d773c6d60736 on hv-cinder-82786 Feb 09 13:12:16.924174 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-56bec68c-edd3-4be3-810c-3c086a5f17ff req-2caa0d90-5829-4b47-be41-4af65896010d service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049890 Feb 09 13:12:16.926975 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 84/176] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:12:16.933860 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c19b676b-bd55-4f21-a630-b7d29f274d5f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:16.934978 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-c19b676b-bd55-4f21-a630-b7d29f274d5f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:16.941145 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c19b676b-bd55-4f21-a630-b7d29f274d5f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:16.941603 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c19b676b-bd55-4f21-a630-b7d29f274d5f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:16.942448 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c19b676b-bd55-4f21-a630-b7d29f274d5f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:16.942905 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c19b676b-bd55-4f21-a630-b7d29f274d5f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:16.959637 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-25518b79-dce6-45f9-a079-1be68d38771d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:16.966951 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-25518b79-dce6-45f9-a079-1be68d38771d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1314 microversion: 2.1 time: 0.188731 Feb 09 13:12:16.967524 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 93/177] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:16 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:17.079289 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c19b676b-bd55-4f21-a630-b7d29f274d5f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:17.086851 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c19b676b-bd55-4f21-a630-b7d29f274d5f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.158575 Feb 09 13:12:17.096513 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 85/178] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:16 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:17.289671 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d45b4ad3-3dde-48c5-90b4-b31d5f2c6683 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:17.291036 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d45b4ad3-3dde-48c5-90b4-b31d5f2c6683 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:17.299212 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d45b4ad3-3dde-48c5-90b4-b31d5f2c6683 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:17.299665 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d45b4ad3-3dde-48c5-90b4-b31d5f2c6683 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:17.300574 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d45b4ad3-3dde-48c5-90b4-b31d5f2c6683 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:17.301403 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d45b4ad3-3dde-48c5-90b4-b31d5f2c6683 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:17.369245 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d45b4ad3-3dde-48c5-90b4-b31d5f2c6683 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c855a6b9dc36484195969a2dd6f3fc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd874f35c2a4960b06af720a09e2d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:17.378119 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d45b4ad3-3dde-48c5-90b4-b31d5f2c6683 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 200 len: 1346 microversion: 2.1 time: 0.092666 Feb 09 13:12:17.378737 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 94/179] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:17 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 1346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:17.986750 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-5c4a9187-f22b-4a8b-b306-ee0a203f8937 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:17.986750 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-5c4a9187-f22b-4a8b-b306-ee0a203f8937 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:17.994042 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5c4a9187-f22b-4a8b-b306-ee0a203f8937 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:17.994602 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5c4a9187-f22b-4a8b-b306-ee0a203f8937 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:17.995727 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5c4a9187-f22b-4a8b-b306-ee0a203f8937 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:17.996167 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5c4a9187-f22b-4a8b-b306-ee0a203f8937 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:18.103483 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-3c2ec0cc-6c83-4ce1-beb6-43c935f0492b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:18.104096 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-3c2ec0cc-6c83-4ce1-beb6-43c935f0492b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:18.110656 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3c2ec0cc-6c83-4ce1-beb6-43c935f0492b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:18.111113 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3c2ec0cc-6c83-4ce1-beb6-43c935f0492b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:18.111901 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3c2ec0cc-6c83-4ce1-beb6-43c935f0492b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:18.112843 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3c2ec0cc-6c83-4ce1-beb6-43c935f0492b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:18.225593 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-5c4a9187-f22b-4a8b-b306-ee0a203f8937 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:18.233676 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-5c4a9187-f22b-4a8b-b306-ee0a203f8937 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1314 microversion: 2.1 time: 0.253941 Feb 09 13:12:18.234389 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 86/180] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:17 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:18.268541 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-3c2ec0cc-6c83-4ce1-beb6-43c935f0492b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:18.276490 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-3c2ec0cc-6c83-4ce1-beb6-43c935f0492b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.176933 Feb 09 13:12:18.277054 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 95/181] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:18 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:18.394405 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-7543b753-ea5d-4bd3-af69-00e3d0c5c2c9 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:18.395366 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-7543b753-ea5d-4bd3-af69-00e3d0c5c2c9 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:18.401674 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7543b753-ea5d-4bd3-af69-00e3d0c5c2c9 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:18.404129 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7543b753-ea5d-4bd3-af69-00e3d0c5c2c9 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:18.404129 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7543b753-ea5d-4bd3-af69-00e3d0c5c2c9 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:18.404129 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7543b753-ea5d-4bd3-af69-00e3d0c5c2c9 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:18.416604 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-7543b753-ea5d-4bd3-af69-00e3d0c5c2c9 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] HTTP exception thrown: Instance 3449e9bb-2fd1-40a5-8003-d773c6d60736 could not be found. Feb 09 13:12:18.417197 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-7543b753-ea5d-4bd3-af69-00e3d0c5c2c9 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Returning 404 to user: Instance 3449e9bb-2fd1-40a5-8003-d773c6d60736 could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:12:18.418027 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-7543b753-ea5d-4bd3-af69-00e3d0c5c2c9 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 404 len: 111 microversion: 2.1 time: 0.027316 Feb 09 13:12:18.418577 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 87/182] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:18 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:12:18.533239 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-f50b1422-8eda-4f97-9fbd-bfe70d603fef tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:18.534233 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-f50b1422-8eda-4f97-9fbd-bfe70d603fef tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:18.541119 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f50b1422-8eda-4f97-9fbd-bfe70d603fef tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:18.541582 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f50b1422-8eda-4f97-9fbd-bfe70d603fef tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:18.542399 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f50b1422-8eda-4f97-9fbd-bfe70d603fef tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:18.543022 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f50b1422-8eda-4f97-9fbd-bfe70d603fef tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:18.556384 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.wsgi [None req-f50b1422-8eda-4f97-9fbd-bfe70d603fef tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] HTTP exception thrown: Instance 3449e9bb-2fd1-40a5-8003-d773c6d60736 could not be found. Feb 09 13:12:18.557051 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-f50b1422-8eda-4f97-9fbd-bfe70d603fef tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Returning 404 to user: Instance 3449e9bb-2fd1-40a5-8003-d773c6d60736 could not be found. {{(pid=116748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:12:18.557878 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-f50b1422-8eda-4f97-9fbd-bfe70d603fef tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028437 Feb 09 13:12:18.558413 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 96/183] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:12:18 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736/os-volume_attachments => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:12:19.250530 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-a389e44b-55af-443e-805f-ec4c41120839 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:19.251201 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-a389e44b-55af-443e-805f-ec4c41120839 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:19.258041 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a389e44b-55af-443e-805f-ec4c41120839 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:19.258496 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a389e44b-55af-443e-805f-ec4c41120839 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:19.259319 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a389e44b-55af-443e-805f-ec4c41120839 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:19.264074 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a389e44b-55af-443e-805f-ec4c41120839 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:19.293244 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-f23330ba-4a7e-42e3-b30a-275176211e37 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:19.301647 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-f23330ba-4a7e-42e3-b30a-275176211e37 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:19.301647 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f23330ba-4a7e-42e3-b30a-275176211e37 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:19.301647 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f23330ba-4a7e-42e3-b30a-275176211e37 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:19.301647 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f23330ba-4a7e-42e3-b30a-275176211e37 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:19.301979 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f23330ba-4a7e-42e3-b30a-275176211e37 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:19.405875 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-a389e44b-55af-443e-805f-ec4c41120839 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:19.415019 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-a389e44b-55af-443e-805f-ec4c41120839 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1314 microversion: 2.1 time: 0.168075 Feb 09 13:12:19.416036 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 88/184] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:19 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:19.469046 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f23330ba-4a7e-42e3-b30a-275176211e37 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:19.477353 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-f23330ba-4a7e-42e3-b30a-275176211e37 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.187795 Feb 09 13:12:19.478333 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 97/185] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:19 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:20.107732 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d4c358c0-f2cd-47ad-b144-ff0d8a321951 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:20.108230 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d4c358c0-f2cd-47ad-b144-ff0d8a321951 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:20.116252 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d4c358c0-f2cd-47ad-b144-ff0d8a321951 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:20.119374 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d4c358c0-f2cd-47ad-b144-ff0d8a321951 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:20.119374 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d4c358c0-f2cd-47ad-b144-ff0d8a321951 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:20.119374 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d4c358c0-f2cd-47ad-b144-ff0d8a321951 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:20.132900 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-d4c358c0-f2cd-47ad-b144-ff0d8a321951 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] HTTP exception thrown: Instance 3449e9bb-2fd1-40a5-8003-d773c6d60736 could not be found. Feb 09 13:12:20.133613 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d4c358c0-f2cd-47ad-b144-ff0d8a321951 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Returning 404 to user: Instance 3449e9bb-2fd1-40a5-8003-d773c6d60736 could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:12:20.134394 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d4c358c0-f2cd-47ad-b144-ff0d8a321951 tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "DELETE /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 404 len: 111 microversion: 2.1 time: 0.030867 Feb 09 13:12:20.135169 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 89/186] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:12:20 2022] DELETE /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:12:20.143264 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-f66348a3-f749-4236-ae1a-11a677d5fe6f tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:20.144278 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-f66348a3-f749-4236-ae1a-11a677d5fe6f tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] [instance: 3449e9bb-2fd1-40a5-8003-d773c6d60736] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:20.156714 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f66348a3-f749-4236-ae1a-11a677d5fe6f tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:20.157300 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f66348a3-f749-4236-ae1a-11a677d5fe6f tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:20.158171 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f66348a3-f749-4236-ae1a-11a677d5fe6f tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:20.158879 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f66348a3-f749-4236-ae1a-11a677d5fe6f tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:20.176160 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.wsgi [None req-f66348a3-f749-4236-ae1a-11a677d5fe6f tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] HTTP exception thrown: Instance 3449e9bb-2fd1-40a5-8003-d773c6d60736 could not be found. Feb 09 13:12:20.176770 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-f66348a3-f749-4236-ae1a-11a677d5fe6f tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] Returning 404 to user: Instance 3449e9bb-2fd1-40a5-8003-d773c6d60736 could not be found. {{(pid=116748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:12:20.177602 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-f66348a3-f749-4236-ae1a-11a677d5fe6f tempest-DeleteServersTestJSON-1452186864 tempest-DeleteServersTestJSON-1452186864-project] 10.222.0.84 "GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736" status: 404 len: 111 microversion: 2.1 time: 0.038516 Feb 09 13:12:20.178156 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 98/187] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:20 2022] GET /compute/v2.1/servers/3449e9bb-2fd1-40a5-8003-d773c6d60736 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:12:20.439705 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-89cda00e-3f00-4a04-a11b-dd10a4264e94 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:20.439705 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-89cda00e-3f00-4a04-a11b-dd10a4264e94 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:20.439705 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-89cda00e-3f00-4a04-a11b-dd10a4264e94 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:20.439705 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-89cda00e-3f00-4a04-a11b-dd10a4264e94 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:20.440506 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-89cda00e-3f00-4a04-a11b-dd10a4264e94 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:20.440951 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-89cda00e-3f00-4a04-a11b-dd10a4264e94 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:20.494713 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-da5875c2-4160-4f4a-8de6-2daf617a1399 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:20.495957 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-da5875c2-4160-4f4a-8de6-2daf617a1399 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:20.503356 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-da5875c2-4160-4f4a-8de6-2daf617a1399 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:20.503894 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-da5875c2-4160-4f4a-8de6-2daf617a1399 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:20.504805 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-da5875c2-4160-4f4a-8de6-2daf617a1399 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:20.505467 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-da5875c2-4160-4f4a-8de6-2daf617a1399 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:20.756514 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-da5875c2-4160-4f4a-8de6-2daf617a1399 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:20.757149 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-89cda00e-3f00-4a04-a11b-dd10a4264e94 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:20.766400 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-89cda00e-3f00-4a04-a11b-dd10a4264e94 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1314 microversion: 2.1 time: 0.338460 Feb 09 13:12:20.774493 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 90/188] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:20 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:20.794257 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-da5875c2-4160-4f4a-8de6-2daf617a1399 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.303140 Feb 09 13:12:20.798152 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 99/189] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:20 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:20.866665 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-0f71f783-4cd0-46b5-bda5-b3529d859d3b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1974573882", "imageRef": "af86cedd-e7d5-4a28-a810-f47830f4bffc", "flavorRef": "452", "networks": [{"uuid": "ff34e378-f58b-45e9-a487-b72107a8e88d"}]}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:12:20.952994 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.network.neutron [None req-0f71f783-4cd0-46b5-bda5-b3529d859d3b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] validate_networks() for [('ff34e378-f58b-45e9-a487-b72107a8e88d', None, None, None, None, None)] {{(pid=116749) validate_networks /opt/stack/nova/nova/network/neutron.py:2554}} Feb 09 13:12:21.582804 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-0f71f783-4cd0-46b5-bda5-b3529d859d3b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Flavor limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 09 13:12:21.584416 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-0f71f783-4cd0-46b5-bda5-b3529d859d3b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Image limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 09 13:12:21.584416 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-0f71f783-4cd0-46b5-bda5-b3529d859d3b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Flavor pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 09 13:12:21.584416 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-0f71f783-4cd0-46b5-bda5-b3529d859d3b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Image pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 09 13:12:21.584674 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-0f71f783-4cd0-46b5-bda5-b3529d859d3b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 09 13:12:21.595596 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0f71f783-4cd0-46b5-bda5-b3529d859d3b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:21.596067 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0f71f783-4cd0-46b5-bda5-b3529d859d3b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:21.596856 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0f71f783-4cd0-46b5-bda5-b3529d859d3b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:21.597322 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0f71f783-4cd0-46b5-bda5-b3529d859d3b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:21.616831 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-0f71f783-4cd0-46b5-bda5-b3529d859d3b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Getting quotas for project a0e498b288c5455ea4e270d16d92dc89. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:12:21.623031 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-0f71f783-4cd0-46b5-bda5-b3529d859d3b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Getting quotas for user 39ee736e50d340be8da8586ee48fc7b5 and project a0e498b288c5455ea4e270d16d92dc89. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:12:21.646915 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-0f71f783-4cd0-46b5-bda5-b3529d859d3b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Going to run 1 instances... {{(pid=116749) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 09 13:12:21.651575 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-0f71f783-4cd0-46b5-bda5-b3529d859d3b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af86cedd-e7d5-4a28-a810-f47830f4bffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 09 13:12:21.792254 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d66b26ee-368b-46cd-8a76-62bdcd0909fc tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:21.793553 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d66b26ee-368b-46cd-8a76-62bdcd0909fc tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:21.802047 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d66b26ee-368b-46cd-8a76-62bdcd0909fc tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:21.802762 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d66b26ee-368b-46cd-8a76-62bdcd0909fc tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:21.805034 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d66b26ee-368b-46cd-8a76-62bdcd0909fc tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:21.805034 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d66b26ee-368b-46cd-8a76-62bdcd0909fc tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:21.836429 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-0f71f783-4cd0-46b5-bda5-b3529d859d3b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.974191 Feb 09 13:12:21.842940 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 91/190] 10.222.0.84 () {60 vars in 1146 bytes} [Wed Feb 9 13:12:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 09 13:12:21.847829 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8256f912-8da7-4870-82b6-23377f318a68 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:21.848638 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8256f912-8da7-4870-82b6-23377f318a68 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:21.860026 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8256f912-8da7-4870-82b6-23377f318a68 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:21.860802 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8256f912-8da7-4870-82b6-23377f318a68 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:21.861894 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8256f912-8da7-4870-82b6-23377f318a68 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:21.862766 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8256f912-8da7-4870-82b6-23377f318a68 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:22.132137 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8256f912-8da7-4870-82b6-23377f318a68 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:22.142213 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8256f912-8da7-4870-82b6-23377f318a68 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.297149 Feb 09 13:12:22.143456 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 92/191] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:21 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:22.149022 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-cc224f78-50e6-41cc-af5a-38be4add47bc tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:22.149978 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-cc224f78-50e6-41cc-af5a-38be4add47bc tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:22.208629 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-cc224f78-50e6-41cc-af5a-38be4add47bc tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:22.217882 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-cc224f78-50e6-41cc-af5a-38be4add47bc tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1218 microversion: 2.1 time: 0.073050 Feb 09 13:12:22.218470 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 93/192] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:22 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:22.353885 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d66b26ee-368b-46cd-8a76-62bdcd0909fc tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:22.362980 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d66b26ee-368b-46cd-8a76-62bdcd0909fc tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1314 microversion: 2.1 time: 0.573883 Feb 09 13:12:22.363904 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 100/193] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:21 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:22.451190 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-167d22ba-e97b-4525-a34f-3fcb59ca759a req-3094023c-7664-4f43-8507-4965b337d479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "362638ad-9f61-4ae2-87da-0627354c362c", "name": "network-vif-plugged", "status": "completed", "tag": "a0dc95c2-e8e7-465f-8598-f6cdc40e23e4"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:12:22.453032 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:12:22.453032 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:12:22.461551 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-167d22ba-e97b-4525-a34f-3fcb59ca759a req-3094023c-7664-4f43-8507-4965b337d479 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:22.462747 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-167d22ba-e97b-4525-a34f-3fcb59ca759a req-3094023c-7664-4f43-8507-4965b337d479 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:22.472724 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-167d22ba-e97b-4525-a34f-3fcb59ca759a req-3094023c-7664-4f43-8507-4965b337d479 service nova] Creating event network-vif-plugged:a0dc95c2-e8e7-465f-8598-f6cdc40e23e4 for instance 362638ad-9f61-4ae2-87da-0627354c362c on hv-cinder-82786 Feb 09 13:12:22.477861 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-167d22ba-e97b-4525-a34f-3fcb59ca759a req-3094023c-7664-4f43-8507-4965b337d479 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030349 Feb 09 13:12:22.478674 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 94/194] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:12:23.160527 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-a8533560-89b4-4d31-a6f4-9f0fca504aa2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:23.161206 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-a8533560-89b4-4d31-a6f4-9f0fca504aa2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:23.168491 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a8533560-89b4-4d31-a6f4-9f0fca504aa2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:23.169004 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a8533560-89b4-4d31-a6f4-9f0fca504aa2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:23.169836 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a8533560-89b4-4d31-a6f4-9f0fca504aa2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:23.170313 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a8533560-89b4-4d31-a6f4-9f0fca504aa2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:23.237478 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-9c4de877-1a1b-4525-b908-98bfbb8e74e2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:23.239079 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-9c4de877-1a1b-4525-b908-98bfbb8e74e2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:23.249148 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9c4de877-1a1b-4525-b908-98bfbb8e74e2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:23.249775 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9c4de877-1a1b-4525-b908-98bfbb8e74e2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:23.251012 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9c4de877-1a1b-4525-b908-98bfbb8e74e2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:23.251855 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9c4de877-1a1b-4525-b908-98bfbb8e74e2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:23.327873 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a8533560-89b4-4d31-a6f4-9f0fca504aa2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:23.337219 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-9c4de877-1a1b-4525-b908-98bfbb8e74e2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:23.337743 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-a8533560-89b4-4d31-a6f4-9f0fca504aa2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.180688 Feb 09 13:12:23.338881 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 101/195] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:23 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:23.361364 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-9c4de877-1a1b-4525-b908-98bfbb8e74e2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1222 microversion: 2.1 time: 0.129292 Feb 09 13:12:23.362085 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 95/196] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:23 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1222 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:23.379625 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-cb69e02a-a6b1-40fb-b06a-403e8e2d857c tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:23.380428 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-cb69e02a-a6b1-40fb-b06a-403e8e2d857c tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:23.386220 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cb69e02a-a6b1-40fb-b06a-403e8e2d857c tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:23.386863 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cb69e02a-a6b1-40fb-b06a-403e8e2d857c tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:23.387823 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cb69e02a-a6b1-40fb-b06a-403e8e2d857c tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:23.388269 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cb69e02a-a6b1-40fb-b06a-403e8e2d857c tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:23.532032 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-cb69e02a-a6b1-40fb-b06a-403e8e2d857c tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:23.539997 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-cb69e02a-a6b1-40fb-b06a-403e8e2d857c tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1314 microversion: 2.1 time: 0.163936 Feb 09 13:12:23.540571 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 102/197] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:23 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:24.354616 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-45c41b70-1e6f-42de-9892-f862a9fc824c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:24.355370 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-45c41b70-1e6f-42de-9892-f862a9fc824c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:24.361590 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-45c41b70-1e6f-42de-9892-f862a9fc824c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:24.362037 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-45c41b70-1e6f-42de-9892-f862a9fc824c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:24.362837 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-45c41b70-1e6f-42de-9892-f862a9fc824c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:24.363268 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-45c41b70-1e6f-42de-9892-f862a9fc824c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:24.377773 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-17cd583b-7feb-428b-9144-601fa1c31ad6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:24.378397 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-17cd583b-7feb-428b-9144-601fa1c31ad6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:24.385644 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-17cd583b-7feb-428b-9144-601fa1c31ad6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:24.386190 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-17cd583b-7feb-428b-9144-601fa1c31ad6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:24.387067 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-17cd583b-7feb-428b-9144-601fa1c31ad6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:24.387507 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-17cd583b-7feb-428b-9144-601fa1c31ad6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:24.454387 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-17cd583b-7feb-428b-9144-601fa1c31ad6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:24.462222 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-17cd583b-7feb-428b-9144-601fa1c31ad6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1270 microversion: 2.1 time: 0.088017 Feb 09 13:12:24.463352 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 103/198] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:24 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:24.502991 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-45c41b70-1e6f-42de-9892-f862a9fc824c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:24.510452 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-45c41b70-1e6f-42de-9892-f862a9fc824c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.159633 Feb 09 13:12:24.511075 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 96/199] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:24 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:24.556569 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-124dd50c-35ef-49d8-908f-d18766165d2f tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:24.557182 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-124dd50c-35ef-49d8-908f-d18766165d2f tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:24.563082 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-124dd50c-35ef-49d8-908f-d18766165d2f tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:24.563540 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-124dd50c-35ef-49d8-908f-d18766165d2f tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:24.564333 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-124dd50c-35ef-49d8-908f-d18766165d2f tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:24.564779 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-124dd50c-35ef-49d8-908f-d18766165d2f tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:24.710438 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-124dd50c-35ef-49d8-908f-d18766165d2f tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:24.717968 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-124dd50c-35ef-49d8-908f-d18766165d2f tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1314 microversion: 2.1 time: 0.165699 Feb 09 13:12:24.718574 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 104/200] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:24 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:25.479695 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d72e4a93-19e8-4fc1-b082-90ceb9d6b712 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:25.480306 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d72e4a93-19e8-4fc1-b082-90ceb9d6b712 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:25.486848 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d72e4a93-19e8-4fc1-b082-90ceb9d6b712 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:25.487296 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d72e4a93-19e8-4fc1-b082-90ceb9d6b712 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:25.488081 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d72e4a93-19e8-4fc1-b082-90ceb9d6b712 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:25.488517 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d72e4a93-19e8-4fc1-b082-90ceb9d6b712 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:25.528715 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-43d73225-a26f-448f-b3a8-532cda55529a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:25.529312 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-43d73225-a26f-448f-b3a8-532cda55529a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:25.535247 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-43d73225-a26f-448f-b3a8-532cda55529a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:25.535717 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-43d73225-a26f-448f-b3a8-532cda55529a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:25.536691 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-43d73225-a26f-448f-b3a8-532cda55529a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:25.537130 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-43d73225-a26f-448f-b3a8-532cda55529a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:25.558471 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-d72e4a93-19e8-4fc1-b082-90ceb9d6b712 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:25.566112 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d72e4a93-19e8-4fc1-b082-90ceb9d6b712 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1270 microversion: 2.1 time: 0.090594 Feb 09 13:12:25.575264 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 97/201] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:25 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:25.690643 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-43d73225-a26f-448f-b3a8-532cda55529a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:25.706756 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-43d73225-a26f-448f-b3a8-532cda55529a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.174533 Feb 09 13:12:25.706756 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 105/202] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:25 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:25.735790 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-e8b8b917-351d-4b26-9851-77ebe1e1263d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:25.736684 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-e8b8b917-351d-4b26-9851-77ebe1e1263d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:25.743228 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e8b8b917-351d-4b26-9851-77ebe1e1263d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:25.743755 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e8b8b917-351d-4b26-9851-77ebe1e1263d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:25.744673 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e8b8b917-351d-4b26-9851-77ebe1e1263d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:25.745120 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e8b8b917-351d-4b26-9851-77ebe1e1263d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:25.995176 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-e8b8b917-351d-4b26-9851-77ebe1e1263d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:26.003033 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-e8b8b917-351d-4b26-9851-77ebe1e1263d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1314 microversion: 2.1 time: 0.271281 Feb 09 13:12:26.003753 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 98/203] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:25 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:26.589443 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d8611ca1-564e-4f71-9060-758bb81836d3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:26.589443 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d8611ca1-564e-4f71-9060-758bb81836d3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:26.592792 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d8611ca1-564e-4f71-9060-758bb81836d3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:26.593387 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d8611ca1-564e-4f71-9060-758bb81836d3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:26.594164 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d8611ca1-564e-4f71-9060-758bb81836d3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:26.594685 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d8611ca1-564e-4f71-9060-758bb81836d3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:26.668781 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d8611ca1-564e-4f71-9060-758bb81836d3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:26.678380 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d8611ca1-564e-4f71-9060-758bb81836d3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1270 microversion: 2.1 time: 0.098243 Feb 09 13:12:26.680883 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 106/204] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:26 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:26.716469 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-46974b73-6f78-40de-9373-78f6a896e4a2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:26.717546 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-46974b73-6f78-40de-9373-78f6a896e4a2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:26.728386 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-46974b73-6f78-40de-9373-78f6a896e4a2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:26.728386 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-46974b73-6f78-40de-9373-78f6a896e4a2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:26.728386 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-46974b73-6f78-40de-9373-78f6a896e4a2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:26.728386 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-46974b73-6f78-40de-9373-78f6a896e4a2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:27.022657 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-5c059170-5f0b-4a5b-8d97-d6e8279e4315 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:27.025675 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-5c059170-5f0b-4a5b-8d97-d6e8279e4315 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:27.031826 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5c059170-5f0b-4a5b-8d97-d6e8279e4315 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:27.032358 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5c059170-5f0b-4a5b-8d97-d6e8279e4315 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:27.033414 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5c059170-5f0b-4a5b-8d97-d6e8279e4315 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:27.033950 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5c059170-5f0b-4a5b-8d97-d6e8279e4315 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:27.078857 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-46974b73-6f78-40de-9373-78f6a896e4a2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:27.086719 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-46974b73-6f78-40de-9373-78f6a896e4a2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.374639 Feb 09 13:12:27.087335 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 99/205] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:26 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:27.232440 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-5c059170-5f0b-4a5b-8d97-d6e8279e4315 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:27.244819 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-5c059170-5f0b-4a5b-8d97-d6e8279e4315 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1314 microversion: 2.1 time: 0.226299 Feb 09 13:12:27.249103 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 107/206] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:27 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:27.695569 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-3845490f-247b-4713-9d4a-653a9b597c97 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:27.696019 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-3845490f-247b-4713-9d4a-653a9b597c97 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:27.702329 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3845490f-247b-4713-9d4a-653a9b597c97 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:27.702807 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3845490f-247b-4713-9d4a-653a9b597c97 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:27.703813 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3845490f-247b-4713-9d4a-653a9b597c97 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:27.704419 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3845490f-247b-4713-9d4a-653a9b597c97 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:27.826399 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3845490f-247b-4713-9d4a-653a9b597c97 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:27.834203 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-3845490f-247b-4713-9d4a-653a9b597c97 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1276 microversion: 2.1 time: 0.142818 Feb 09 13:12:27.834907 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 100/207] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:27 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:28.105980 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-3137dbea-f2a9-4e86-b002-b2232c3788d2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:28.106749 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-3137dbea-f2a9-4e86-b002-b2232c3788d2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:28.113223 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3137dbea-f2a9-4e86-b002-b2232c3788d2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:28.113797 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3137dbea-f2a9-4e86-b002-b2232c3788d2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:28.114731 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3137dbea-f2a9-4e86-b002-b2232c3788d2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:28.115239 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3137dbea-f2a9-4e86-b002-b2232c3788d2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:28.287287 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-7bbfec3a-1943-4866-ac48-e0de3a30931d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:28.288678 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-3137dbea-f2a9-4e86-b002-b2232c3788d2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:28.288787 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-7bbfec3a-1943-4866-ac48-e0de3a30931d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:28.304198 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-3137dbea-f2a9-4e86-b002-b2232c3788d2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.203900 Feb 09 13:12:28.310390 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 108/208] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:28 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:28.310982 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7bbfec3a-1943-4866-ac48-e0de3a30931d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:28.312064 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7bbfec3a-1943-4866-ac48-e0de3a30931d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:28.312905 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7bbfec3a-1943-4866-ac48-e0de3a30931d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:28.313336 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7bbfec3a-1943-4866-ac48-e0de3a30931d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:28.522961 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-7bbfec3a-1943-4866-ac48-e0de3a30931d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:28.533786 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-7bbfec3a-1943-4866-ac48-e0de3a30931d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1498 microversion: 2.1 time: 0.271267 Feb 09 13:12:28.534835 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 101/209] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:28 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1498 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:28.855767 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-97856213-7e83-4b7f-9368-7873684ece6f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:28.856382 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-97856213-7e83-4b7f-9368-7873684ece6f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:28.862227 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-97856213-7e83-4b7f-9368-7873684ece6f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:28.862849 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-97856213-7e83-4b7f-9368-7873684ece6f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:28.863639 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-97856213-7e83-4b7f-9368-7873684ece6f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:28.864075 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-97856213-7e83-4b7f-9368-7873684ece6f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:29.162201 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-97856213-7e83-4b7f-9368-7873684ece6f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:29.176111 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-97856213-7e83-4b7f-9368-7873684ece6f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1318 microversion: 2.1 time: 0.324389 Feb 09 13:12:29.184113 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 109/210] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:28 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:29.330586 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c71b6324-f608-4a8b-8470-ca889e8f119c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:29.331845 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-c71b6324-f608-4a8b-8470-ca889e8f119c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:29.342166 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c71b6324-f608-4a8b-8470-ca889e8f119c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:29.343124 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c71b6324-f608-4a8b-8470-ca889e8f119c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:29.344292 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c71b6324-f608-4a8b-8470-ca889e8f119c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:29.347741 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c71b6324-f608-4a8b-8470-ca889e8f119c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:29.500844 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c71b6324-f608-4a8b-8470-ca889e8f119c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:29.510963 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c71b6324-f608-4a8b-8470-ca889e8f119c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.189371 Feb 09 13:12:29.518510 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 102/211] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:29 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:30.193360 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-9fb4b7f0-1973-4c63-959f-3763adaa2a0e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:30.193880 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-9fb4b7f0-1973-4c63-959f-3763adaa2a0e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:30.204865 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9fb4b7f0-1973-4c63-959f-3763adaa2a0e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:30.205321 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9fb4b7f0-1973-4c63-959f-3763adaa2a0e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:30.206104 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9fb4b7f0-1973-4c63-959f-3763adaa2a0e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:30.208755 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9fb4b7f0-1973-4c63-959f-3763adaa2a0e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:30.528709 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-425dc108-965c-4088-ab93-ac1a1ef0f4ca tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:30.529980 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-425dc108-965c-4088-ab93-ac1a1ef0f4ca tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:30.541670 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-425dc108-965c-4088-ab93-ac1a1ef0f4ca tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:30.547180 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-425dc108-965c-4088-ab93-ac1a1ef0f4ca tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:30.548427 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-425dc108-965c-4088-ab93-ac1a1ef0f4ca tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:30.549080 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-425dc108-965c-4088-ab93-ac1a1ef0f4ca tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:30.887127 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-9fb4b7f0-1973-4c63-959f-3763adaa2a0e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:30.898637 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-9fb4b7f0-1973-4c63-959f-3763adaa2a0e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1318 microversion: 2.1 time: 0.709124 Feb 09 13:12:30.900783 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 110/212] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:30 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1318 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:30.912047 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-425dc108-965c-4088-ab93-ac1a1ef0f4ca tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:30.922217 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-425dc108-965c-4088-ab93-ac1a1ef0f4ca tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.397040 Feb 09 13:12:30.923409 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 103/213] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:30 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:31.282821 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-7acf807e-284f-496b-b1be-a0d93aa2a19b req-3e25d9cf-1554-4a12-9701-d6da952fb612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74d73213-038a-446e-a171-6bf526f06626", "tag": "84c81437-1fbd-4c50-87de-41f47b4410a0"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:12:31.284611 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:12:31.284611 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:12:31.304215 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-7acf807e-284f-496b-b1be-a0d93aa2a19b req-3e25d9cf-1554-4a12-9701-d6da952fb612 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:31.304991 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-7acf807e-284f-496b-b1be-a0d93aa2a19b req-3e25d9cf-1554-4a12-9701-d6da952fb612 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:31.307111 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-9b5636db-f8b1-4803-93c8-4736d9d5eb88 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Action: 'create', calling method: .version_select at 0x7f7f64b293a0>, body: {"keypair": {"name": "tempest-keypair-32048109"}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:12:31.326156 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-7acf807e-284f-496b-b1be-a0d93aa2a19b req-3e25d9cf-1554-4a12-9701-d6da952fb612 service nova] Creating event network-changed:84c81437-1fbd-4c50-87de-41f47b4410a0 for instance 74d73213-038a-446e-a171-6bf526f06626 on hv-cinder-82786 Feb 09 13:12:31.330312 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-9b5636db-f8b1-4803-93c8-4736d9d5eb88 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Getting quotas for project dd4edb9e42144956ae9a0a0f8c99bb71. Resources: {'key_pairs'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:12:31.332046 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-7acf807e-284f-496b-b1be-a0d93aa2a19b req-3e25d9cf-1554-4a12-9701-d6da952fb612 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054412 Feb 09 13:12:31.332974 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 104/214] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:12:31.335841 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-9b5636db-f8b1-4803-93c8-4736d9d5eb88 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Getting quotas for user 58dc0b9f64334ecb9a325e6511786a61 and project dd4edb9e42144956ae9a0a0f8c99bb71. Resources: {'key_pairs'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:12:31.841141 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-9b5636db-f8b1-4803-93c8-4736d9d5eb88 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Getting quotas for project dd4edb9e42144956ae9a0a0f8c99bb71. Resources: {'key_pairs'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:12:31.846092 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-9b5636db-f8b1-4803-93c8-4736d9d5eb88 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Getting quotas for user 58dc0b9f64334ecb9a325e6511786a61 and project dd4edb9e42144956ae9a0a0f8c99bb71. Resources: {'key_pairs'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:12:31.878197 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-9b5636db-f8b1-4803-93c8-4736d9d5eb88 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 201 len: 2318 microversion: 2.20 time: 0.714157 Feb 09 13:12:31.878197 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 111/215] 10.222.0.84 () {62 vars in 1198 bytes} [Wed Feb 9 13:12:31 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 719 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 09 13:12:31.920832 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ec9e4e3c-dd93-4324-aeff-199cb79e78a3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:31.921611 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-ec9e4e3c-dd93-4324-aeff-199cb79e78a3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:31.928510 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ec9e4e3c-dd93-4324-aeff-199cb79e78a3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:31.928967 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ec9e4e3c-dd93-4324-aeff-199cb79e78a3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:31.929823 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ec9e4e3c-dd93-4324-aeff-199cb79e78a3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:31.930272 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ec9e4e3c-dd93-4324-aeff-199cb79e78a3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:31.940040 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-9a1425b9-0cab-4976-bf9c-3f30525948fb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:31.940040 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-9a1425b9-0cab-4976-bf9c-3f30525948fb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:31.952966 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9a1425b9-0cab-4976-bf9c-3f30525948fb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:31.953692 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9a1425b9-0cab-4976-bf9c-3f30525948fb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:31.954738 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9a1425b9-0cab-4976-bf9c-3f30525948fb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:31.955334 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9a1425b9-0cab-4976-bf9c-3f30525948fb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:32.174096 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-9a1425b9-0cab-4976-bf9c-3f30525948fb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:32.184002 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-9a1425b9-0cab-4976-bf9c-3f30525948fb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.248542 Feb 09 13:12:32.184625 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 112/216] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:31 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:32.189905 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-040ce4a3-ecc7-41ed-8043-6b8c8e93796b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:32.190634 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-040ce4a3-ecc7-41ed-8043-6b8c8e93796b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:32.199003 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-040ce4a3-ecc7-41ed-8043-6b8c8e93796b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:32.200028 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-040ce4a3-ecc7-41ed-8043-6b8c8e93796b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:32.201136 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-040ce4a3-ecc7-41ed-8043-6b8c8e93796b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:32.201859 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-040ce4a3-ecc7-41ed-8043-6b8c8e93796b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:32.214993 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ec9e4e3c-dd93-4324-aeff-199cb79e78a3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:32.223613 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-ec9e4e3c-dd93-4324-aeff-199cb79e78a3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1318 microversion: 2.1 time: 0.310659 Feb 09 13:12:32.224406 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 105/217] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:31 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:32.239978 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-040ce4a3-ecc7-41ed-8043-6b8c8e93796b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Going to try to terminate instance {{(pid=116748) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 09 13:12:32.756601 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-040ce4a3-ecc7-41ed-8043-6b8c8e93796b tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "DELETE /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 204 len: 0 microversion: 2.1 time: 0.566839 Feb 09 13:12:32.757767 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 113/218] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:12:32 2022] DELETE /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 0 bytes in 572 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 09 13:12:32.768529 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-16e93648-8fd5-45d0-b911-f04fe2f8428d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:32.769181 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-16e93648-8fd5-45d0-b911-f04fe2f8428d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:32.781790 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-16e93648-8fd5-45d0-b911-f04fe2f8428d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:32.782507 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-16e93648-8fd5-45d0-b911-f04fe2f8428d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:32.784240 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-16e93648-8fd5-45d0-b911-f04fe2f8428d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:32.784687 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-16e93648-8fd5-45d0-b911-f04fe2f8428d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:33.023477 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-16e93648-8fd5-45d0-b911-f04fe2f8428d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:33.031145 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-16e93648-8fd5-45d0-b911-f04fe2f8428d tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1504 microversion: 2.1 time: 0.266464 Feb 09 13:12:33.031716 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 106/219] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:32 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:33.202651 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-0d1a6433-a999-4055-b2f2-0a2ffa5bf658 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:33.203455 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-0d1a6433-a999-4055-b2f2-0a2ffa5bf658 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:33.216822 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0d1a6433-a999-4055-b2f2-0a2ffa5bf658 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:33.217572 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0d1a6433-a999-4055-b2f2-0a2ffa5bf658 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:33.218707 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0d1a6433-a999-4055-b2f2-0a2ffa5bf658 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:33.219390 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0d1a6433-a999-4055-b2f2-0a2ffa5bf658 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:33.243067 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-864e0f19-ae7a-4946-bb4e-ff972766d05d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:33.243961 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-864e0f19-ae7a-4946-bb4e-ff972766d05d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:33.252070 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-864e0f19-ae7a-4946-bb4e-ff972766d05d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:33.258390 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-864e0f19-ae7a-4946-bb4e-ff972766d05d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:33.259692 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-864e0f19-ae7a-4946-bb4e-ff972766d05d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:33.260351 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-864e0f19-ae7a-4946-bb4e-ff972766d05d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:33.392964 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-0d1a6433-a999-4055-b2f2-0a2ffa5bf658 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:33.401471 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-0d1a6433-a999-4055-b2f2-0a2ffa5bf658 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.203324 Feb 09 13:12:33.405102 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 114/220] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:33 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:33.494847 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-864e0f19-ae7a-4946-bb4e-ff972766d05d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:33.503743 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-864e0f19-ae7a-4946-bb4e-ff972766d05d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1318 microversion: 2.1 time: 0.266088 Feb 09 13:12:33.505275 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 107/221] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:33 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:34.049388 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-61617079-7d69-4fc3-982f-e70ef9d9a69e tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:34.050036 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-61617079-7d69-4fc3-982f-e70ef9d9a69e tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:34.060985 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-61617079-7d69-4fc3-982f-e70ef9d9a69e tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:34.062121 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-61617079-7d69-4fc3-982f-e70ef9d9a69e tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:34.063038 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-61617079-7d69-4fc3-982f-e70ef9d9a69e tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:34.063618 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-61617079-7d69-4fc3-982f-e70ef9d9a69e tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:34.269181 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-61617079-7d69-4fc3-982f-e70ef9d9a69e tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:34.282215 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-61617079-7d69-4fc3-982f-e70ef9d9a69e tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1504 microversion: 2.1 time: 0.236329 Feb 09 13:12:34.290661 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 115/222] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:34 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:34.426759 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-a884e110-652e-436e-98e4-391b47e85953 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:34.427720 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-a884e110-652e-436e-98e4-391b47e85953 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:34.435435 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a884e110-652e-436e-98e4-391b47e85953 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:34.435889 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a884e110-652e-436e-98e4-391b47e85953 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:34.436822 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a884e110-652e-436e-98e4-391b47e85953 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:34.437266 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a884e110-652e-436e-98e4-391b47e85953 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:34.520920 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-6ee454cb-d3a4-4df2-80d4-8caab4bc018f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:34.522373 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-6ee454cb-d3a4-4df2-80d4-8caab4bc018f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:34.533821 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6ee454cb-d3a4-4df2-80d4-8caab4bc018f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:34.534590 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6ee454cb-d3a4-4df2-80d4-8caab4bc018f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:34.535471 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6ee454cb-d3a4-4df2-80d4-8caab4bc018f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:34.535972 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6ee454cb-d3a4-4df2-80d4-8caab4bc018f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:34.718287 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-a884e110-652e-436e-98e4-391b47e85953 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:34.728967 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-a884e110-652e-436e-98e4-391b47e85953 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.306067 Feb 09 13:12:34.737010 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 108/223] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:34 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:34.799506 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6ee454cb-d3a4-4df2-80d4-8caab4bc018f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:34.807453 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-6ee454cb-d3a4-4df2-80d4-8caab4bc018f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1318 microversion: 2.1 time: 0.290854 Feb 09 13:12:34.808043 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 116/224] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:34 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:35.179465 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-31f08d9a-5dbe-47e6-8dbc-d562544176d4 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-509996547", "imageRef": "af86cedd-e7d5-4a28-a810-f47830f4bffc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a32947b8-36d8-4e31-8400-b282b6379a3d"}], "security_groups": [{"name": "tempest-securitygroup--655528873"}], "key_name": "tempest-keypair-32048109", "user_data": "}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:12:35.294666 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.network.neutron [None req-31f08d9a-5dbe-47e6-8dbc-d562544176d4 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] validate_networks() for [('a32947b8-36d8-4e31-8400-b282b6379a3d', None, None, None, None, None)] {{(pid=116749) validate_networks /opt/stack/nova/nova/network/neutron.py:2554}} Feb 09 13:12:35.299525 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-a6a1c5dd-5f55-4947-a6fc-f84e57b25403 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:35.300143 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-a6a1c5dd-5f55-4947-a6fc-f84e57b25403 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:35.307747 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a6a1c5dd-5f55-4947-a6fc-f84e57b25403 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:35.308925 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a6a1c5dd-5f55-4947-a6fc-f84e57b25403 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:35.310604 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a6a1c5dd-5f55-4947-a6fc-f84e57b25403 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:35.311274 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a6a1c5dd-5f55-4947-a6fc-f84e57b25403 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:35.481921 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a6a1c5dd-5f55-4947-a6fc-f84e57b25403 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:35.489846 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-a6a1c5dd-5f55-4947-a6fc-f84e57b25403 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1504 microversion: 2.1 time: 0.194161 Feb 09 13:12:35.499630 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 117/225] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:35 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1504 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:35.706091 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-31f08d9a-5dbe-47e6-8dbc-d562544176d4 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Flavor limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 09 13:12:35.706635 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-31f08d9a-5dbe-47e6-8dbc-d562544176d4 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Image limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 09 13:12:35.707028 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-31f08d9a-5dbe-47e6-8dbc-d562544176d4 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Flavor pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 09 13:12:35.707440 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-31f08d9a-5dbe-47e6-8dbc-d562544176d4 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Image pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 09 13:12:35.707850 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-31f08d9a-5dbe-47e6-8dbc-d562544176d4 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 09 13:12:35.717743 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-31f08d9a-5dbe-47e6-8dbc-d562544176d4 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:35.718199 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-31f08d9a-5dbe-47e6-8dbc-d562544176d4 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:35.719083 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-31f08d9a-5dbe-47e6-8dbc-d562544176d4 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:35.719574 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-31f08d9a-5dbe-47e6-8dbc-d562544176d4 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:35.735898 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-31f08d9a-5dbe-47e6-8dbc-d562544176d4 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Getting quotas for project dd4edb9e42144956ae9a0a0f8c99bb71. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:12:35.739809 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-31f08d9a-5dbe-47e6-8dbc-d562544176d4 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Getting quotas for user 58dc0b9f64334ecb9a325e6511786a61 and project dd4edb9e42144956ae9a0a0f8c99bb71. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:12:35.745737 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-ad95de45-d578-4389-a7f6-437acb5add33 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:35.746352 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-ad95de45-d578-4389-a7f6-437acb5add33 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:35.750796 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-31f08d9a-5dbe-47e6-8dbc-d562544176d4 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Going to run 1 instances... {{(pid=116749) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 09 13:12:35.752025 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ad95de45-d578-4389-a7f6-437acb5add33 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:35.752477 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ad95de45-d578-4389-a7f6-437acb5add33 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:35.753125 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-31f08d9a-5dbe-47e6-8dbc-d562544176d4 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af86cedd-e7d5-4a28-a810-f47830f4bffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 09 13:12:35.753271 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ad95de45-d578-4389-a7f6-437acb5add33 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:35.753679 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ad95de45-d578-4389-a7f6-437acb5add33 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:35.877445 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-31f08d9a-5dbe-47e6-8dbc-d562544176d4 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.702127 Feb 09 13:12:35.878195 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 109/226] 10.222.0.84 () {62 vars in 1187 bytes} [Wed Feb 9 13:12:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 09 13:12:35.883980 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-9fecb231-6191-4566-b579-d6a4dedffee2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:35.884843 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-9fecb231-6191-4566-b579-d6a4dedffee2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:35.892372 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9fecb231-6191-4566-b579-d6a4dedffee2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:35.892822 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9fecb231-6191-4566-b579-d6a4dedffee2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:35.893609 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9fecb231-6191-4566-b579-d6a4dedffee2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:35.894041 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9fecb231-6191-4566-b579-d6a4dedffee2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:35.943623 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ad95de45-d578-4389-a7f6-437acb5add33 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:35.952697 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-ad95de45-d578-4389-a7f6-437acb5add33 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.210526 Feb 09 13:12:35.953762 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 118/227] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:35 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:35.960386 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-144a1088-b117-4da3-b70a-0931828c02e2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:35.961196 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-144a1088-b117-4da3-b70a-0931828c02e2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:36.019530 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-144a1088-b117-4da3-b70a-0931828c02e2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:36.031582 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-144a1088-b117-4da3-b70a-0931828c02e2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:36.033194 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-144a1088-b117-4da3-b70a-0931828c02e2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:36.034338 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-144a1088-b117-4da3-b70a-0931828c02e2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1279 microversion: 2.20 time: 0.079306 Feb 09 13:12:36.035046 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 119/228] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:12:35 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1279 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:12:36.142718 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-9fecb231-6191-4566-b579-d6a4dedffee2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:36.151135 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-9fecb231-6191-4566-b579-d6a4dedffee2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1318 microversion: 2.1 time: 0.271720 Feb 09 13:12:36.151798 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 110/229] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:35 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:36.506577 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-0c59fe88-cce3-4b4d-8209-127ae6d33da4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:36.507205 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-0c59fe88-cce3-4b4d-8209-127ae6d33da4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:36.514772 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0c59fe88-cce3-4b4d-8209-127ae6d33da4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:36.515282 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0c59fe88-cce3-4b4d-8209-127ae6d33da4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:36.516027 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0c59fe88-cce3-4b4d-8209-127ae6d33da4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:36.516468 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0c59fe88-cce3-4b4d-8209-127ae6d33da4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:36.654477 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-0c59fe88-cce3-4b4d-8209-127ae6d33da4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:36.661983 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-0c59fe88-cce3-4b4d-8209-127ae6d33da4 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1504 microversion: 2.1 time: 0.158875 Feb 09 13:12:36.662917 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 120/230] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:36 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:36.970502 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-700b7e51-14e0-4fd7-a087-b647e4cc079a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:36.971146 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-700b7e51-14e0-4fd7-a087-b647e4cc079a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:36.980919 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-700b7e51-14e0-4fd7-a087-b647e4cc079a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:36.981370 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-700b7e51-14e0-4fd7-a087-b647e4cc079a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:36.982159 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-700b7e51-14e0-4fd7-a087-b647e4cc079a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:36.982663 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-700b7e51-14e0-4fd7-a087-b647e4cc079a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:37.052985 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-10dd7fb1-d083-4952-81c0-d1e5b57d78ee tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:37.053847 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-10dd7fb1-d083-4952-81c0-d1e5b57d78ee tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:37.059692 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-10dd7fb1-d083-4952-81c0-d1e5b57d78ee tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:37.060135 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-10dd7fb1-d083-4952-81c0-d1e5b57d78ee tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:37.060930 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-10dd7fb1-d083-4952-81c0-d1e5b57d78ee tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:37.061493 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-10dd7fb1-d083-4952-81c0-d1e5b57d78ee tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:37.128763 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-10dd7fb1-d083-4952-81c0-d1e5b57d78ee tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:37.144761 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-10dd7fb1-d083-4952-81c0-d1e5b57d78ee tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:37.151462 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-10dd7fb1-d083-4952-81c0-d1e5b57d78ee tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:37.152974 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-10dd7fb1-d083-4952-81c0-d1e5b57d78ee tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1283 microversion: 2.20 time: 0.103947 Feb 09 13:12:37.154017 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 121/231] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:12:37 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1283 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:12:37.169217 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-946c1fc7-53e0-4910-88f2-ea9072ba2068 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:37.170217 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-946c1fc7-53e0-4910-88f2-ea9072ba2068 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:37.177972 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-946c1fc7-53e0-4910-88f2-ea9072ba2068 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:37.178818 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-946c1fc7-53e0-4910-88f2-ea9072ba2068 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:37.179924 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-946c1fc7-53e0-4910-88f2-ea9072ba2068 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:37.180625 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-946c1fc7-53e0-4910-88f2-ea9072ba2068 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:37.229212 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-700b7e51-14e0-4fd7-a087-b647e4cc079a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:37.245949 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-700b7e51-14e0-4fd7-a087-b647e4cc079a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.279697 Feb 09 13:12:37.259460 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 111/232] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:36 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:37.377967 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-946c1fc7-53e0-4910-88f2-ea9072ba2068 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:37.385848 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-946c1fc7-53e0-4910-88f2-ea9072ba2068 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1318 microversion: 2.1 time: 0.221576 Feb 09 13:12:37.386429 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 122/233] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:37 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:37.624756 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-b4d879c2-75bc-43f1-ae8f-94828fd04e72 req-1b923b3e-4f39-4ba7-974c-77df525bd780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "362638ad-9f61-4ae2-87da-0627354c362c", "name": "network-vif-deleted", "tag": "a0dc95c2-e8e7-465f-8598-f6cdc40e23e4"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:12:37.626356 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:12:37.626356 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:12:37.640531 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-b4d879c2-75bc-43f1-ae8f-94828fd04e72 req-1b923b3e-4f39-4ba7-974c-77df525bd780 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:37.641295 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-b4d879c2-75bc-43f1-ae8f-94828fd04e72 req-1b923b3e-4f39-4ba7-974c-77df525bd780 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:37.653907 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-b4d879c2-75bc-43f1-ae8f-94828fd04e72 req-1b923b3e-4f39-4ba7-974c-77df525bd780 service nova] Creating event network-vif-deleted:a0dc95c2-e8e7-465f-8598-f6cdc40e23e4 for instance 362638ad-9f61-4ae2-87da-0627354c362c on hv-cinder-82786 Feb 09 13:12:37.658880 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-b4d879c2-75bc-43f1-ae8f-94828fd04e72 req-1b923b3e-4f39-4ba7-974c-77df525bd780 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038852 Feb 09 13:12:37.659464 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 112/234] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:12:37.686755 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-cb5ed79b-4f74-41bb-9536-8ad474c378b7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:37.686755 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-cb5ed79b-4f74-41bb-9536-8ad474c378b7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:37.689754 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cb5ed79b-4f74-41bb-9536-8ad474c378b7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:37.690310 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cb5ed79b-4f74-41bb-9536-8ad474c378b7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:37.691234 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cb5ed79b-4f74-41bb-9536-8ad474c378b7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:37.691992 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cb5ed79b-4f74-41bb-9536-8ad474c378b7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:37.767516 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-cb5ed79b-4f74-41bb-9536-8ad474c378b7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:37.783936 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-cb5ed79b-4f74-41bb-9536-8ad474c378b7 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1462 microversion: 2.1 time: 0.104221 Feb 09 13:12:37.784539 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 123/235] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:37 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1462 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:38.173995 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-5e88e014-31c9-46c4-9971-891d24e2ad20 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:38.174736 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-5e88e014-31c9-46c4-9971-891d24e2ad20 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:38.184208 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5e88e014-31c9-46c4-9971-891d24e2ad20 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:38.184615 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5e88e014-31c9-46c4-9971-891d24e2ad20 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:38.185427 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5e88e014-31c9-46c4-9971-891d24e2ad20 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:38.185927 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5e88e014-31c9-46c4-9971-891d24e2ad20 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:38.250369 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-5e88e014-31c9-46c4-9971-891d24e2ad20 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:38.258207 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-5e88e014-31c9-46c4-9971-891d24e2ad20 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:38.259855 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-5e88e014-31c9-46c4-9971-891d24e2ad20 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:38.260963 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-5e88e014-31c9-46c4-9971-891d24e2ad20 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1331 microversion: 2.20 time: 0.092804 Feb 09 13:12:38.261511 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 113/236] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:12:38 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1331 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:12:38.264908 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-22618db0-497c-48e2-be80-abe33366174f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:38.265738 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-22618db0-497c-48e2-be80-abe33366174f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:38.271534 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-22618db0-497c-48e2-be80-abe33366174f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:38.271994 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-22618db0-497c-48e2-be80-abe33366174f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:38.275101 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-22618db0-497c-48e2-be80-abe33366174f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:38.275101 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-22618db0-497c-48e2-be80-abe33366174f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:38.404974 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-1ef5d4bc-8a20-43f8-9f71-44ceaff02311 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:38.406084 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-1ef5d4bc-8a20-43f8-9f71-44ceaff02311 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:38.413978 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1ef5d4bc-8a20-43f8-9f71-44ceaff02311 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:38.416320 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1ef5d4bc-8a20-43f8-9f71-44ceaff02311 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:38.417364 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1ef5d4bc-8a20-43f8-9f71-44ceaff02311 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:38.418403 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1ef5d4bc-8a20-43f8-9f71-44ceaff02311 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:38.449217 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-22618db0-497c-48e2-be80-abe33366174f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:38.457059 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-22618db0-497c-48e2-be80-abe33366174f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.196326 Feb 09 13:12:38.457637 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 124/237] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:38 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:38.593964 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-1ef5d4bc-8a20-43f8-9f71-44ceaff02311 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:38.601325 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-1ef5d4bc-8a20-43f8-9f71-44ceaff02311 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1318 microversion: 2.1 time: 0.202431 Feb 09 13:12:38.602921 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 114/238] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:38 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:38.803617 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-9ec540e9-b8d9-430d-b4df-b40810b852d0 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:38.804376 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-9ec540e9-b8d9-430d-b4df-b40810b852d0 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:38.810573 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9ec540e9-b8d9-430d-b4df-b40810b852d0 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:38.811032 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9ec540e9-b8d9-430d-b4df-b40810b852d0 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:38.811851 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9ec540e9-b8d9-430d-b4df-b40810b852d0 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:38.812316 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9ec540e9-b8d9-430d-b4df-b40810b852d0 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:38.841882 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9ec540e9-b8d9-430d-b4df-b40810b852d0 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:38.842236 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9ec540e9-b8d9-430d-b4df-b40810b852d0 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:38.842708 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-9ec540e9-b8d9-430d-b4df-b40810b852d0 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lazy-loading 'fault' on Instance uuid 362638ad-9f61-4ae2-87da-0627354c362c {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:12:38.880911 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-9ec540e9-b8d9-430d-b4df-b40810b852d0 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:38.902680 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-9ec540e9-b8d9-430d-b4df-b40810b852d0 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1304 microversion: 2.1 time: 0.088117 Feb 09 13:12:38.902680 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 125/239] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:38 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1304 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:39.283238 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-b7490e2e-75be-486d-bc5c-53c6b1807622 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:39.283849 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-b7490e2e-75be-486d-bc5c-53c6b1807622 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:39.292407 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b7490e2e-75be-486d-bc5c-53c6b1807622 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:39.292407 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b7490e2e-75be-486d-bc5c-53c6b1807622 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:39.292605 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b7490e2e-75be-486d-bc5c-53c6b1807622 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:39.292958 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b7490e2e-75be-486d-bc5c-53c6b1807622 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:39.359062 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-b7490e2e-75be-486d-bc5c-53c6b1807622 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:39.368488 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-b7490e2e-75be-486d-bc5c-53c6b1807622 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:39.370021 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-b7490e2e-75be-486d-bc5c-53c6b1807622 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:39.371333 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-b7490e2e-75be-486d-bc5c-53c6b1807622 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1331 microversion: 2.20 time: 0.091968 Feb 09 13:12:39.381884 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 115/240] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:12:39 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:12:39.475099 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-e52669ba-9bdd-44ea-9c2c-f9ee907d9beb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:39.475677 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-e52669ba-9bdd-44ea-9c2c-f9ee907d9beb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:39.481952 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e52669ba-9bdd-44ea-9c2c-f9ee907d9beb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:39.482441 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e52669ba-9bdd-44ea-9c2c-f9ee907d9beb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:39.483293 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e52669ba-9bdd-44ea-9c2c-f9ee907d9beb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:39.483813 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e52669ba-9bdd-44ea-9c2c-f9ee907d9beb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:39.620251 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d4a4c613-dd01-44ac-b2b6-8c2375e3d415 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:39.620865 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d4a4c613-dd01-44ac-b2b6-8c2375e3d415 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:39.626707 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d4a4c613-dd01-44ac-b2b6-8c2375e3d415 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:39.627167 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d4a4c613-dd01-44ac-b2b6-8c2375e3d415 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:39.627952 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d4a4c613-dd01-44ac-b2b6-8c2375e3d415 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:39.628550 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d4a4c613-dd01-44ac-b2b6-8c2375e3d415 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:39.644687 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e52669ba-9bdd-44ea-9c2c-f9ee907d9beb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:39.655814 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-e52669ba-9bdd-44ea-9c2c-f9ee907d9beb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.184374 Feb 09 13:12:39.656421 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 126/241] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:39 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:39.770185 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-d4a4c613-dd01-44ac-b2b6-8c2375e3d415 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:39.777864 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d4a4c613-dd01-44ac-b2b6-8c2375e3d415 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1318 microversion: 2.1 time: 0.161769 Feb 09 13:12:39.778432 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 116/242] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:39 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:39.909244 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-c663c337-8dc0-439f-a94e-52e0aed570f2 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:39.910340 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-c663c337-8dc0-439f-a94e-52e0aed570f2 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:39.917888 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c663c337-8dc0-439f-a94e-52e0aed570f2 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:39.918320 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c663c337-8dc0-439f-a94e-52e0aed570f2 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:39.919176 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c663c337-8dc0-439f-a94e-52e0aed570f2 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:39.919606 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c663c337-8dc0-439f-a94e-52e0aed570f2 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:39.952043 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c663c337-8dc0-439f-a94e-52e0aed570f2 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:39.952493 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c663c337-8dc0-439f-a94e-52e0aed570f2 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:39.952944 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-c663c337-8dc0-439f-a94e-52e0aed570f2 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lazy-loading 'fault' on Instance uuid 362638ad-9f61-4ae2-87da-0627354c362c {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:12:39.994597 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-c663c337-8dc0-439f-a94e-52e0aed570f2 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:40.011996 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-c663c337-8dc0-439f-a94e-52e0aed570f2 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1304 microversion: 2.1 time: 0.110309 Feb 09 13:12:40.016502 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 127/243] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:39 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:40.388438 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-797b2f73-595c-4082-af4e-9d3d901be5b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:40.388980 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-797b2f73-595c-4082-af4e-9d3d901be5b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:40.395582 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-797b2f73-595c-4082-af4e-9d3d901be5b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:40.396029 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-797b2f73-595c-4082-af4e-9d3d901be5b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:40.396995 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-797b2f73-595c-4082-af4e-9d3d901be5b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:40.397459 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-797b2f73-595c-4082-af4e-9d3d901be5b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:40.461299 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-797b2f73-595c-4082-af4e-9d3d901be5b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:40.470188 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-797b2f73-595c-4082-af4e-9d3d901be5b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:40.471822 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-797b2f73-595c-4082-af4e-9d3d901be5b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:40.473097 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-797b2f73-595c-4082-af4e-9d3d901be5b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1331 microversion: 2.20 time: 0.088481 Feb 09 13:12:40.473656 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 117/244] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:12:40 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1331 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:12:40.672404 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-5abd00c1-0b14-48de-8597-5dde13e190a8 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:40.672931 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-5abd00c1-0b14-48de-8597-5dde13e190a8 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:40.679023 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5abd00c1-0b14-48de-8597-5dde13e190a8 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:40.679474 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5abd00c1-0b14-48de-8597-5dde13e190a8 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:40.680847 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5abd00c1-0b14-48de-8597-5dde13e190a8 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:40.681331 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5abd00c1-0b14-48de-8597-5dde13e190a8 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:40.794463 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-91368b7e-6a93-4f43-aaf7-d77c677547dd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:40.795235 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-91368b7e-6a93-4f43-aaf7-d77c677547dd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:40.803744 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-91368b7e-6a93-4f43-aaf7-d77c677547dd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:40.806099 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-91368b7e-6a93-4f43-aaf7-d77c677547dd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:40.806099 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-91368b7e-6a93-4f43-aaf7-d77c677547dd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:40.807097 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-91368b7e-6a93-4f43-aaf7-d77c677547dd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:40.824112 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-5abd00c1-0b14-48de-8597-5dde13e190a8 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:40.843616 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-5abd00c1-0b14-48de-8597-5dde13e190a8 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.174839 Feb 09 13:12:40.844213 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 128/245] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:40 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:41.019253 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-91368b7e-6a93-4f43-aaf7-d77c677547dd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:41.031248 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-351dc0fc-e2f5-4fe3-a383-8e9ae511dd17 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:41.032727 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-351dc0fc-e2f5-4fe3-a383-8e9ae511dd17 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:41.033200 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-91368b7e-6a93-4f43-aaf7-d77c677547dd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1318 microversion: 2.1 time: 0.243131 Feb 09 13:12:41.034505 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 118/246] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:40 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:41.045978 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-351dc0fc-e2f5-4fe3-a383-8e9ae511dd17 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:41.046479 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-351dc0fc-e2f5-4fe3-a383-8e9ae511dd17 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:41.047457 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-351dc0fc-e2f5-4fe3-a383-8e9ae511dd17 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:41.048217 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-351dc0fc-e2f5-4fe3-a383-8e9ae511dd17 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:41.097375 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-351dc0fc-e2f5-4fe3-a383-8e9ae511dd17 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:41.097825 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-351dc0fc-e2f5-4fe3-a383-8e9ae511dd17 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:41.098478 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-351dc0fc-e2f5-4fe3-a383-8e9ae511dd17 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lazy-loading 'fault' on Instance uuid 362638ad-9f61-4ae2-87da-0627354c362c {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:12:41.152225 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-351dc0fc-e2f5-4fe3-a383-8e9ae511dd17 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cec126a43b4dc2b0f18af629b718ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989aed5dea7448f6aff599d6744ccec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:41.171281 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-351dc0fc-e2f5-4fe3-a383-8e9ae511dd17 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 200 len: 1304 microversion: 2.1 time: 0.143379 Feb 09 13:12:41.172705 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 129/247] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:41 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 1304 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:41.490957 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-3a5a9382-999a-4e2f-b310-e9b9a297c7c3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:41.491570 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-3a5a9382-999a-4e2f-b310-e9b9a297c7c3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:41.498065 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3a5a9382-999a-4e2f-b310-e9b9a297c7c3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:41.498808 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3a5a9382-999a-4e2f-b310-e9b9a297c7c3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:41.499606 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3a5a9382-999a-4e2f-b310-e9b9a297c7c3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:41.500041 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3a5a9382-999a-4e2f-b310-e9b9a297c7c3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:41.608766 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3a5a9382-999a-4e2f-b310-e9b9a297c7c3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:41.618508 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3a5a9382-999a-4e2f-b310-e9b9a297c7c3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:41.620204 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3a5a9382-999a-4e2f-b310-e9b9a297c7c3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:41.621378 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-3a5a9382-999a-4e2f-b310-e9b9a297c7c3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1337 microversion: 2.20 time: 0.134122 Feb 09 13:12:41.632299 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 119/248] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:12:41 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1337 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:12:41.860625 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-1731de53-bfd8-43d6-a287-1f2b99dabfe3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:41.861322 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-1731de53-bfd8-43d6-a287-1f2b99dabfe3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:41.868334 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1731de53-bfd8-43d6-a287-1f2b99dabfe3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:41.869009 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1731de53-bfd8-43d6-a287-1f2b99dabfe3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:41.870344 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1731de53-bfd8-43d6-a287-1f2b99dabfe3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:41.870961 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1731de53-bfd8-43d6-a287-1f2b99dabfe3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:42.050083 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-1731de53-bfd8-43d6-a287-1f2b99dabfe3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:42.051599 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-65bd9318-686e-4039-b88b-2d5d7de17541 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:42.052642 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-65bd9318-686e-4039-b88b-2d5d7de17541 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:42.060858 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-65bd9318-686e-4039-b88b-2d5d7de17541 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:42.061644 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-65bd9318-686e-4039-b88b-2d5d7de17541 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:42.062877 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-65bd9318-686e-4039-b88b-2d5d7de17541 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:42.063473 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-65bd9318-686e-4039-b88b-2d5d7de17541 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:42.070389 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-1731de53-bfd8-43d6-a287-1f2b99dabfe3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.213308 Feb 09 13:12:42.073855 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 130/249] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:41 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:42.189804 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-3f4c8700-8f1b-4285-b830-127f51962267 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:42.190417 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-3f4c8700-8f1b-4285-b830-127f51962267 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] [instance: 362638ad-9f61-4ae2-87da-0627354c362c] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:42.209190 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3f4c8700-8f1b-4285-b830-127f51962267 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:42.209876 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3f4c8700-8f1b-4285-b830-127f51962267 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:42.211261 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3f4c8700-8f1b-4285-b830-127f51962267 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:42.212440 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3f4c8700-8f1b-4285-b830-127f51962267 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:42.239193 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.wsgi [None req-3f4c8700-8f1b-4285-b830-127f51962267 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] HTTP exception thrown: Instance 362638ad-9f61-4ae2-87da-0627354c362c could not be found. Feb 09 13:12:42.239884 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-3f4c8700-8f1b-4285-b830-127f51962267 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] Returning 404 to user: Instance 362638ad-9f61-4ae2-87da-0627354c362c could not be found. {{(pid=116748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:12:42.241593 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-3f4c8700-8f1b-4285-b830-127f51962267 tempest-VolumesActionsTest-487045940 tempest-VolumesActionsTest-487045940-project] 10.222.0.84 "GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c" status: 404 len: 111 microversion: 2.1 time: 0.056455 Feb 09 13:12:42.242674 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 131/250] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:42 2022] GET /compute/v2.1/servers/362638ad-9f61-4ae2-87da-0627354c362c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 09 13:12:42.375860 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-65bd9318-686e-4039-b88b-2d5d7de17541 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:42.383678 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-65bd9318-686e-4039-b88b-2d5d7de17541 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1318 microversion: 2.1 time: 0.336785 Feb 09 13:12:42.388443 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 120/251] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:42 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:42.639618 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-a5c427ad-2526-4a5d-9da6-ec3f56eb133c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:42.640230 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-a5c427ad-2526-4a5d-9da6-ec3f56eb133c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:42.646227 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a5c427ad-2526-4a5d-9da6-ec3f56eb133c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:42.646742 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a5c427ad-2526-4a5d-9da6-ec3f56eb133c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:42.647562 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a5c427ad-2526-4a5d-9da6-ec3f56eb133c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:42.648004 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a5c427ad-2526-4a5d-9da6-ec3f56eb133c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:42.819414 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a5c427ad-2526-4a5d-9da6-ec3f56eb133c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:42.827531 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a5c427ad-2526-4a5d-9da6-ec3f56eb133c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:42.831246 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a5c427ad-2526-4a5d-9da6-ec3f56eb133c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:42.831246 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-a5c427ad-2526-4a5d-9da6-ec3f56eb133c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1404 microversion: 2.20 time: 0.194395 Feb 09 13:12:42.831246 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 132/252] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:12:42 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1404 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:12:43.090447 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-a49dd87d-b55d-4b0b-a50d-ba819275a54c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:43.091085 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-a49dd87d-b55d-4b0b-a50d-ba819275a54c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:43.104416 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a49dd87d-b55d-4b0b-a50d-ba819275a54c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:43.105220 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a49dd87d-b55d-4b0b-a50d-ba819275a54c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:43.106239 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a49dd87d-b55d-4b0b-a50d-ba819275a54c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:43.106941 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a49dd87d-b55d-4b0b-a50d-ba819275a54c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:43.143383 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-b1e1b6a2-f87f-4e29-9f11-171f4799e0b5 req-f253e80a-da04-43f1-99c3-79e229bf85a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d73213-038a-446e-a171-6bf526f06626", "name": "network-vif-plugged", "status": "completed", "tag": "84c81437-1fbd-4c50-87de-41f47b4410a0"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:12:43.148738 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:12:43.148738 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:12:43.157035 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-b1e1b6a2-f87f-4e29-9f11-171f4799e0b5 req-f253e80a-da04-43f1-99c3-79e229bf85a6 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:43.157485 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-b1e1b6a2-f87f-4e29-9f11-171f4799e0b5 req-f253e80a-da04-43f1-99c3-79e229bf85a6 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:43.174329 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-b1e1b6a2-f87f-4e29-9f11-171f4799e0b5 req-f253e80a-da04-43f1-99c3-79e229bf85a6 service nova] Creating event network-vif-plugged:84c81437-1fbd-4c50-87de-41f47b4410a0 for instance 74d73213-038a-446e-a171-6bf526f06626 on hv-cinder-82786 Feb 09 13:12:43.179752 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-b1e1b6a2-f87f-4e29-9f11-171f4799e0b5 req-f253e80a-da04-43f1-99c3-79e229bf85a6 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040318 Feb 09 13:12:43.183119 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 133/253] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Feb 09 13:12:43.332942 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-a49dd87d-b55d-4b0b-a50d-ba819275a54c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:43.341055 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-a49dd87d-b55d-4b0b-a50d-ba819275a54c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.254856 Feb 09 13:12:43.343335 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 121/254] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:43 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:43.406681 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-829e466c-6ae4-4e6f-9ce8-455cfd555c9f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:43.407567 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-829e466c-6ae4-4e6f-9ce8-455cfd555c9f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:43.415398 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-829e466c-6ae4-4e6f-9ce8-455cfd555c9f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:43.415891 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-829e466c-6ae4-4e6f-9ce8-455cfd555c9f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:43.416859 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-829e466c-6ae4-4e6f-9ce8-455cfd555c9f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:43.417313 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-829e466c-6ae4-4e6f-9ce8-455cfd555c9f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:43.659642 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-829e466c-6ae4-4e6f-9ce8-455cfd555c9f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:43.679731 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-829e466c-6ae4-4e6f-9ce8-455cfd555c9f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1318 microversion: 2.1 time: 0.278077 Feb 09 13:12:43.681010 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 134/255] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:43 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:43.847539 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-1c8d79e0-ff8e-4eda-9558-01a510332f07 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:43.848143 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-1c8d79e0-ff8e-4eda-9558-01a510332f07 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:43.870753 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-493e9c3f-50dd-45d6-aa2b-41adf367f89e req-a6ff1269-9a06-41ef-9f5f-8ad2d7ed0770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267a95df-7ddb-4e9c-a629-4fc26b9c9843", "tag": "45e332d3-92b6-4aa9-9b18-a8fa5ca22e31"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:12:43.871870 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1c8d79e0-ff8e-4eda-9558-01a510332f07 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:43.873107 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:12:43.873107 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:12:43.876512 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1c8d79e0-ff8e-4eda-9558-01a510332f07 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:43.877421 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1c8d79e0-ff8e-4eda-9558-01a510332f07 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:43.878189 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1c8d79e0-ff8e-4eda-9558-01a510332f07 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:43.887290 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-493e9c3f-50dd-45d6-aa2b-41adf367f89e req-a6ff1269-9a06-41ef-9f5f-8ad2d7ed0770 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:43.889895 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-493e9c3f-50dd-45d6-aa2b-41adf367f89e req-a6ff1269-9a06-41ef-9f5f-8ad2d7ed0770 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:43.909435 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-493e9c3f-50dd-45d6-aa2b-41adf367f89e req-a6ff1269-9a06-41ef-9f5f-8ad2d7ed0770 service nova] Creating event network-changed:45e332d3-92b6-4aa9-9b18-a8fa5ca22e31 for instance 267a95df-7ddb-4e9c-a629-4fc26b9c9843 on hv-cinder-82786 Feb 09 13:12:43.921178 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-493e9c3f-50dd-45d6-aa2b-41adf367f89e req-a6ff1269-9a06-41ef-9f5f-8ad2d7ed0770 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054417 Feb 09 13:12:43.921788 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 135/256] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:12:44.115283 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-1c8d79e0-ff8e-4eda-9558-01a510332f07 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:44.134026 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-1c8d79e0-ff8e-4eda-9558-01a510332f07 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:44.136473 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-1c8d79e0-ff8e-4eda-9558-01a510332f07 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:44.137594 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-1c8d79e0-ff8e-4eda-9558-01a510332f07 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1404 microversion: 2.20 time: 0.293810 Feb 09 13:12:44.138365 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 122/257] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:12:43 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1404 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:12:44.360462 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-e30c2b97-c25a-4572-a725-d2bcb787e127 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:44.361038 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-e30c2b97-c25a-4572-a725-d2bcb787e127 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:44.367277 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e30c2b97-c25a-4572-a725-d2bcb787e127 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:44.368276 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e30c2b97-c25a-4572-a725-d2bcb787e127 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:44.369315 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e30c2b97-c25a-4572-a725-d2bcb787e127 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:44.369950 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e30c2b97-c25a-4572-a725-d2bcb787e127 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:44.520759 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e30c2b97-c25a-4572-a725-d2bcb787e127 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:44.530681 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-e30c2b97-c25a-4572-a725-d2bcb787e127 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.172485 Feb 09 13:12:44.530681 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 136/258] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:44 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:44.696816 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-5ea718d2-d7fa-45f5-9287-b33dee8fe59b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:44.697443 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-5ea718d2-d7fa-45f5-9287-b33dee8fe59b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:44.704543 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5ea718d2-d7fa-45f5-9287-b33dee8fe59b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:44.704991 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5ea718d2-d7fa-45f5-9287-b33dee8fe59b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:44.705773 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5ea718d2-d7fa-45f5-9287-b33dee8fe59b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:44.706203 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5ea718d2-d7fa-45f5-9287-b33dee8fe59b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:44.837041 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-5ea718d2-d7fa-45f5-9287-b33dee8fe59b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:44.844099 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-5ea718d2-d7fa-45f5-9287-b33dee8fe59b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1318 microversion: 2.1 time: 0.151412 Feb 09 13:12:44.844657 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 123/259] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:44 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:45.158138 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-1f69685c-c5c2-47b7-8f03-eb8f243cad4d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:45.158945 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-1f69685c-c5c2-47b7-8f03-eb8f243cad4d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:45.166663 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1f69685c-c5c2-47b7-8f03-eb8f243cad4d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:45.167261 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1f69685c-c5c2-47b7-8f03-eb8f243cad4d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:45.168126 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1f69685c-c5c2-47b7-8f03-eb8f243cad4d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:45.168701 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1f69685c-c5c2-47b7-8f03-eb8f243cad4d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:45.332562 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-1f69685c-c5c2-47b7-8f03-eb8f243cad4d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:45.340821 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-1f69685c-c5c2-47b7-8f03-eb8f243cad4d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:45.342351 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-1f69685c-c5c2-47b7-8f03-eb8f243cad4d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:45.343468 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-1f69685c-c5c2-47b7-8f03-eb8f243cad4d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1404 microversion: 2.20 time: 0.191126 Feb 09 13:12:45.344122 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 137/260] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:12:45 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1404 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:12:45.545364 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ad7d3cf2-f57f-403d-b1eb-8122d160d350 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:45.545976 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-ad7d3cf2-f57f-403d-b1eb-8122d160d350 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:45.552116 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ad7d3cf2-f57f-403d-b1eb-8122d160d350 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:45.552562 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ad7d3cf2-f57f-403d-b1eb-8122d160d350 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:45.553343 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ad7d3cf2-f57f-403d-b1eb-8122d160d350 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:45.553780 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ad7d3cf2-f57f-403d-b1eb-8122d160d350 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:45.698131 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ad7d3cf2-f57f-403d-b1eb-8122d160d350 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:45.706157 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-ad7d3cf2-f57f-403d-b1eb-8122d160d350 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.164604 Feb 09 13:12:45.706784 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 124/261] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:45 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:45.860661 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-004b0cf2-ec33-4a05-92ce-4f921783dcb5 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:45.861184 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-004b0cf2-ec33-4a05-92ce-4f921783dcb5 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:45.867393 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-004b0cf2-ec33-4a05-92ce-4f921783dcb5 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:45.868446 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-004b0cf2-ec33-4a05-92ce-4f921783dcb5 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:45.869292 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-004b0cf2-ec33-4a05-92ce-4f921783dcb5 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:45.869683 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-004b0cf2-ec33-4a05-92ce-4f921783dcb5 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:45.999920 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-004b0cf2-ec33-4a05-92ce-4f921783dcb5 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:46.007172 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-004b0cf2-ec33-4a05-92ce-4f921783dcb5 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1318 microversion: 2.1 time: 0.150298 Feb 09 13:12:46.007747 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 138/262] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:45 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:46.360981 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-533e200f-e655-44fb-9f82-b5d4938c9ec8 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:46.361589 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-533e200f-e655-44fb-9f82-b5d4938c9ec8 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:46.367384 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-533e200f-e655-44fb-9f82-b5d4938c9ec8 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:46.367832 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-533e200f-e655-44fb-9f82-b5d4938c9ec8 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:46.368616 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-533e200f-e655-44fb-9f82-b5d4938c9ec8 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:46.369047 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-533e200f-e655-44fb-9f82-b5d4938c9ec8 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:46.500258 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-533e200f-e655-44fb-9f82-b5d4938c9ec8 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:46.507987 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-533e200f-e655-44fb-9f82-b5d4938c9ec8 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:46.510070 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-533e200f-e655-44fb-9f82-b5d4938c9ec8 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:46.511227 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-533e200f-e655-44fb-9f82-b5d4938c9ec8 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1404 microversion: 2.20 time: 0.153997 Feb 09 13:12:46.511786 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 125/263] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:12:46 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:12:46.722912 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-a9440aba-ca76-4576-b825-b58f09d58cd5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:46.723511 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-a9440aba-ca76-4576-b825-b58f09d58cd5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:46.729637 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a9440aba-ca76-4576-b825-b58f09d58cd5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:46.730080 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a9440aba-ca76-4576-b825-b58f09d58cd5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:46.730887 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a9440aba-ca76-4576-b825-b58f09d58cd5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:46.731327 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a9440aba-ca76-4576-b825-b58f09d58cd5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:46.863495 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a9440aba-ca76-4576-b825-b58f09d58cd5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:46.871810 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-a9440aba-ca76-4576-b825-b58f09d58cd5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.152554 Feb 09 13:12:46.872374 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 139/264] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:46 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:47.023608 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ec203780-3e39-485b-9438-a2b6f346c354 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:47.024453 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-ec203780-3e39-485b-9438-a2b6f346c354 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:47.030644 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ec203780-3e39-485b-9438-a2b6f346c354 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:47.031089 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ec203780-3e39-485b-9438-a2b6f346c354 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:47.031857 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ec203780-3e39-485b-9438-a2b6f346c354 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:47.032286 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ec203780-3e39-485b-9438-a2b6f346c354 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:47.164088 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ec203780-3e39-485b-9438-a2b6f346c354 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:47.171894 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-ec203780-3e39-485b-9438-a2b6f346c354 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1318 microversion: 2.1 time: 0.151924 Feb 09 13:12:47.172465 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 126/265] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:47 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:47.531936 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-68a5d552-7e4d-47b8-b582-6af1c1069481 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:47.532660 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-68a5d552-7e4d-47b8-b582-6af1c1069481 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:47.538417 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-68a5d552-7e4d-47b8-b582-6af1c1069481 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:47.538895 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-68a5d552-7e4d-47b8-b582-6af1c1069481 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:47.540231 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-68a5d552-7e4d-47b8-b582-6af1c1069481 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:47.540671 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-68a5d552-7e4d-47b8-b582-6af1c1069481 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:47.679341 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-68a5d552-7e4d-47b8-b582-6af1c1069481 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:47.687731 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-68a5d552-7e4d-47b8-b582-6af1c1069481 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:47.689288 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-68a5d552-7e4d-47b8-b582-6af1c1069481 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:47.690377 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-68a5d552-7e4d-47b8-b582-6af1c1069481 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1404 microversion: 2.20 time: 0.164587 Feb 09 13:12:47.699251 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 140/266] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:12:47 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:12:47.889109 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-30a81e1e-7f73-4d6a-8ada-8d3778abd152 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:47.889648 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-30a81e1e-7f73-4d6a-8ada-8d3778abd152 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:47.895371 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-30a81e1e-7f73-4d6a-8ada-8d3778abd152 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:47.895825 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-30a81e1e-7f73-4d6a-8ada-8d3778abd152 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:47.896611 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-30a81e1e-7f73-4d6a-8ada-8d3778abd152 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:47.897045 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-30a81e1e-7f73-4d6a-8ada-8d3778abd152 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:48.033476 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-30a81e1e-7f73-4d6a-8ada-8d3778abd152 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:48.040985 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-30a81e1e-7f73-4d6a-8ada-8d3778abd152 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.155614 Feb 09 13:12:48.041553 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 127/267] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:47 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:48.189098 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-2d27e10d-f0db-409e-be50-b07272bbf67b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:48.189764 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-2d27e10d-f0db-409e-be50-b07272bbf67b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:48.196799 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2d27e10d-f0db-409e-be50-b07272bbf67b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:48.200714 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2d27e10d-f0db-409e-be50-b07272bbf67b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:48.200714 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2d27e10d-f0db-409e-be50-b07272bbf67b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:48.200714 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2d27e10d-f0db-409e-be50-b07272bbf67b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:48.333043 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-2d27e10d-f0db-409e-be50-b07272bbf67b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:48.340552 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-2d27e10d-f0db-409e-be50-b07272bbf67b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1507 microversion: 2.1 time: 0.155174 Feb 09 13:12:48.344212 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 141/268] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:48 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:48.358842 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-7c103d54-1906-4b42-928f-1d343ceae0cf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e64beae9-0dc4-4cd0-aeec-11542eb6c28a"}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:12:48.360032 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-7c103d54-1906-4b42-928f-1d343ceae0cf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:48.366361 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7c103d54-1906-4b42-928f-1d343ceae0cf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:48.375457 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7c103d54-1906-4b42-928f-1d343ceae0cf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:48.375457 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7c103d54-1906-4b42-928f-1d343ceae0cf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:48.375457 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7c103d54-1906-4b42-928f-1d343ceae0cf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:48.616264 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-7c103d54-1906-4b42-928f-1d343ceae0cf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] HTTP exception thrown: Invalid volume: volume e64beae9-0dc4-4cd0-aeec-11542eb6c28a is already attached to instances: 894904de-6d54-4785-b905-4a1901d9d87f Feb 09 13:12:48.617087 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-7c103d54-1906-4b42-928f-1d343ceae0cf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Returning 400 to user: Invalid volume: volume e64beae9-0dc4-4cd0-aeec-11542eb6c28a is already attached to instances: 894904de-6d54-4785-b905-4a1901d9d87f {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:12:48.618747 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-7c103d54-1906-4b42-928f-1d343ceae0cf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "POST /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.263270 Feb 09 13:12:48.620020 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 128/269] 10.222.0.84 () {60 vars in 1322 bytes} [Wed Feb 9 13:12:48 2022] POST /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626/os-volume_attachments => generated 174 bytes in 265 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 09 13:12:48.707908 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-177c7e91-1ad5-4773-8fd6-b1ef8e5cda92 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:48.708794 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-177c7e91-1ad5-4773-8fd6-b1ef8e5cda92 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:48.731179 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-177c7e91-1ad5-4773-8fd6-b1ef8e5cda92 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:48.732019 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-177c7e91-1ad5-4773-8fd6-b1ef8e5cda92 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:48.733048 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-177c7e91-1ad5-4773-8fd6-b1ef8e5cda92 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:48.733490 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-177c7e91-1ad5-4773-8fd6-b1ef8e5cda92 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:48.737798 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-2f796598-d25b-4241-a39b-fb621dd25e33 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:48.738901 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-2f796598-d25b-4241-a39b-fb621dd25e33 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:48.747764 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2f796598-d25b-4241-a39b-fb621dd25e33 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:48.748766 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2f796598-d25b-4241-a39b-fb621dd25e33 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:48.751855 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2f796598-d25b-4241-a39b-fb621dd25e33 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:48.751855 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2f796598-d25b-4241-a39b-fb621dd25e33 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:48.891659 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.objects.instance [None req-2f796598-d25b-4241-a39b-fb621dd25e33 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lazy-loading 'services' on Instance uuid 894904de-6d54-4785-b905-4a1901d9d87f {{(pid=116749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:12:48.913809 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-177c7e91-1ad5-4773-8fd6-b1ef8e5cda92 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:48.927189 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-177c7e91-1ad5-4773-8fd6-b1ef8e5cda92 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:48.930197 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-177c7e91-1ad5-4773-8fd6-b1ef8e5cda92 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:48.931465 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-177c7e91-1ad5-4773-8fd6-b1ef8e5cda92 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1404 microversion: 2.20 time: 0.227308 Feb 09 13:12:48.932981 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 142/270] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:12:48 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1404 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:12:49.057541 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-a8be1d9d-11eb-4693-8208-53261ff032a5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:49.058303 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-a8be1d9d-11eb-4693-8208-53261ff032a5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:49.064302 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a8be1d9d-11eb-4693-8208-53261ff032a5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:49.065001 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a8be1d9d-11eb-4693-8208-53261ff032a5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:49.065742 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a8be1d9d-11eb-4693-8208-53261ff032a5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:49.066346 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a8be1d9d-11eb-4693-8208-53261ff032a5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:49.185183 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-2f796598-d25b-4241-a39b-fb621dd25e33 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "DELETE /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f/os-volume_attachments/e64beae9-0dc4-4cd0-aeec-11542eb6c28a" status: 202 len: 0 microversion: 2.1 time: 0.451179 Feb 09 13:12:49.186892 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 129/271] 10.222.0.84 () {58 vars in 1415 bytes} [Wed Feb 9 13:12:48 2022] DELETE /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f/os-volume_attachments/e64beae9-0dc4-4cd0-aeec-11542eb6c28a => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 09 13:12:49.197561 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-5946ccfb-8810-4e2d-b72f-75a6b347757e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:49.199769 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-5946ccfb-8810-4e2d-b72f-75a6b347757e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:49.212472 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5946ccfb-8810-4e2d-b72f-75a6b347757e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:49.213351 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5946ccfb-8810-4e2d-b72f-75a6b347757e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:49.214240 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5946ccfb-8810-4e2d-b72f-75a6b347757e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:49.214757 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5946ccfb-8810-4e2d-b72f-75a6b347757e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:49.241244 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a8be1d9d-11eb-4693-8208-53261ff032a5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:49.250414 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-a8be1d9d-11eb-4693-8208-53261ff032a5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.196599 Feb 09 13:12:49.251113 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 143/272] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:49 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:12:49.262329 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-5946ccfb-8810-4e2d-b72f-75a6b347757e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070841 Feb 09 13:12:49.262972 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 130/273] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:12:49 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:12:49.950813 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-a90d8233-39c9-40f1-bb15-7f9c5dff8294 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:49.951406 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-a90d8233-39c9-40f1-bb15-7f9c5dff8294 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:49.957691 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a90d8233-39c9-40f1-bb15-7f9c5dff8294 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:49.960102 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a90d8233-39c9-40f1-bb15-7f9c5dff8294 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:49.960102 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a90d8233-39c9-40f1-bb15-7f9c5dff8294 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:49.960102 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a90d8233-39c9-40f1-bb15-7f9c5dff8294 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:50.134747 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a90d8233-39c9-40f1-bb15-7f9c5dff8294 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:50.166229 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a90d8233-39c9-40f1-bb15-7f9c5dff8294 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:50.166229 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a90d8233-39c9-40f1-bb15-7f9c5dff8294 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:50.168611 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-a90d8233-39c9-40f1-bb15-7f9c5dff8294 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1404 microversion: 2.20 time: 0.221593 Feb 09 13:12:50.169184 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 144/274] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:12:49 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1404 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:12:50.268982 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-cbcd03ad-4ff7-4ae4-a206-c79ddf5c95a3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:50.269793 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-cbcd03ad-4ff7-4ae4-a206-c79ddf5c95a3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:50.279411 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-2c580128-6e9b-426d-b4f8-7de569d8f482 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:50.282482 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-2c580128-6e9b-426d-b4f8-7de569d8f482 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:50.290942 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2c580128-6e9b-426d-b4f8-7de569d8f482 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:50.294715 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2c580128-6e9b-426d-b4f8-7de569d8f482 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:50.294715 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2c580128-6e9b-426d-b4f8-7de569d8f482 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:50.294715 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2c580128-6e9b-426d-b4f8-7de569d8f482 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:50.295091 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-cbcd03ad-4ff7-4ae4-a206-c79ddf5c95a3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:50.295091 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-cbcd03ad-4ff7-4ae4-a206-c79ddf5c95a3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:50.295091 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-cbcd03ad-4ff7-4ae4-a206-c79ddf5c95a3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:50.295091 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-cbcd03ad-4ff7-4ae4-a206-c79ddf5c95a3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:50.340157 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-2c580128-6e9b-426d-b4f8-7de569d8f482 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068788 Feb 09 13:12:50.341685 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 145/275] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:12:50 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:12:50.512286 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-cbcd03ad-4ff7-4ae4-a206-c79ddf5c95a3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:50.522138 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-cbcd03ad-4ff7-4ae4-a206-c79ddf5c95a3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.256850 Feb 09 13:12:50.526669 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 131/276] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:50 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:51.187327 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-ffc129ed-7705-4ca8-aadd-452c3517dd78 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:51.187962 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-ffc129ed-7705-4ca8-aadd-452c3517dd78 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:51.193896 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ffc129ed-7705-4ca8-aadd-452c3517dd78 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:51.194348 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ffc129ed-7705-4ca8-aadd-452c3517dd78 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:51.195165 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ffc129ed-7705-4ca8-aadd-452c3517dd78 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:51.196225 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ffc129ed-7705-4ca8-aadd-452c3517dd78 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:51.340015 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ffc129ed-7705-4ca8-aadd-452c3517dd78 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:51.348073 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ffc129ed-7705-4ca8-aadd-452c3517dd78 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:51.349749 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ffc129ed-7705-4ca8-aadd-452c3517dd78 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:51.350923 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-ffc129ed-7705-4ca8-aadd-452c3517dd78 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1404 microversion: 2.20 time: 0.167254 Feb 09 13:12:51.351484 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 146/277] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:12:51 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1404 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:12:51.352068 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-4e356ef9-a362-4fa0-9b1a-a0d78f6814d1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:51.353087 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-4e356ef9-a362-4fa0-9b1a-a0d78f6814d1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:51.358996 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4e356ef9-a362-4fa0-9b1a-a0d78f6814d1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:51.359562 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4e356ef9-a362-4fa0-9b1a-a0d78f6814d1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:51.360421 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4e356ef9-a362-4fa0-9b1a-a0d78f6814d1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:51.360933 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4e356ef9-a362-4fa0-9b1a-a0d78f6814d1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:51.390813 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-4e356ef9-a362-4fa0-9b1a-a0d78f6814d1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042681 Feb 09 13:12:51.391380 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 132/278] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:12:51 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:12:51.542726 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-605c49de-f836-4bfc-97eb-bebcdb8efd30 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:51.544950 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-605c49de-f836-4bfc-97eb-bebcdb8efd30 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:51.549887 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-605c49de-f836-4bfc-97eb-bebcdb8efd30 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:51.550453 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-605c49de-f836-4bfc-97eb-bebcdb8efd30 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:51.551752 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-605c49de-f836-4bfc-97eb-bebcdb8efd30 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:51.552403 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-605c49de-f836-4bfc-97eb-bebcdb8efd30 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:51.709686 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-605c49de-f836-4bfc-97eb-bebcdb8efd30 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:51.723002 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-605c49de-f836-4bfc-97eb-bebcdb8efd30 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.184261 Feb 09 13:12:51.735007 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 147/279] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:51 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:52.368502 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c4a0be7e-048a-416f-84d1-7967db3406a7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:52.369107 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-c4a0be7e-048a-416f-84d1-7967db3406a7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:52.375257 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c4a0be7e-048a-416f-84d1-7967db3406a7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:52.375705 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c4a0be7e-048a-416f-84d1-7967db3406a7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:52.376482 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c4a0be7e-048a-416f-84d1-7967db3406a7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:52.376909 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c4a0be7e-048a-416f-84d1-7967db3406a7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:52.402081 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-4f7e02bb-17e6-45f4-b893-7d091a27dbd9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:52.403069 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-4f7e02bb-17e6-45f4-b893-7d091a27dbd9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:52.409373 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4f7e02bb-17e6-45f4-b893-7d091a27dbd9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:52.409813 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4f7e02bb-17e6-45f4-b893-7d091a27dbd9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:52.410867 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4f7e02bb-17e6-45f4-b893-7d091a27dbd9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:52.411299 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4f7e02bb-17e6-45f4-b893-7d091a27dbd9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:52.440122 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-4f7e02bb-17e6-45f4-b893-7d091a27dbd9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042472 Feb 09 13:12:52.440689 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 148/280] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:12:52 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:12:52.526233 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c4a0be7e-048a-416f-84d1-7967db3406a7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:52.534279 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c4a0be7e-048a-416f-84d1-7967db3406a7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:52.535814 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c4a0be7e-048a-416f-84d1-7967db3406a7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:52.536914 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c4a0be7e-048a-416f-84d1-7967db3406a7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1404 microversion: 2.20 time: 0.172190 Feb 09 13:12:52.537474 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 133/281] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:12:52 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:12:52.742356 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-5a701a45-dda6-4321-998f-bfa26c9556bc tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:52.743173 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-5a701a45-dda6-4321-998f-bfa26c9556bc tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:52.753366 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5a701a45-dda6-4321-998f-bfa26c9556bc tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:52.753820 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5a701a45-dda6-4321-998f-bfa26c9556bc tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:52.754650 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5a701a45-dda6-4321-998f-bfa26c9556bc tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:52.756016 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5a701a45-dda6-4321-998f-bfa26c9556bc tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:52.927591 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-5a701a45-dda6-4321-998f-bfa26c9556bc tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:52.935120 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-5a701a45-dda6-4321-998f-bfa26c9556bc tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1520 microversion: 2.1 time: 0.197481 Feb 09 13:12:52.935791 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 149/282] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:52 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:53.451753 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-5f36fd77-0e48-4e40-8f9c-312b6cb56ed3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:53.452962 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-5f36fd77-0e48-4e40-8f9c-312b6cb56ed3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:53.460479 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5f36fd77-0e48-4e40-8f9c-312b6cb56ed3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:53.460930 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5f36fd77-0e48-4e40-8f9c-312b6cb56ed3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:53.462422 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5f36fd77-0e48-4e40-8f9c-312b6cb56ed3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:53.463090 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5f36fd77-0e48-4e40-8f9c-312b6cb56ed3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:53.500977 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-5f36fd77-0e48-4e40-8f9c-312b6cb56ed3 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053380 Feb 09 13:12:53.501594 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 134/283] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:12:53 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 09 13:12:53.556510 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-f35db547-bb3f-49f2-ae4b-60b5f46ec983 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:53.557782 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-f35db547-bb3f-49f2-ae4b-60b5f46ec983 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:53.563962 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f35db547-bb3f-49f2-ae4b-60b5f46ec983 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:53.564316 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f35db547-bb3f-49f2-ae4b-60b5f46ec983 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:53.565158 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f35db547-bb3f-49f2-ae4b-60b5f46ec983 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:53.565594 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f35db547-bb3f-49f2-ae4b-60b5f46ec983 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:53.690305 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-f4246e5e-a80b-4720-bffe-0f7c7630f574 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2111399376", "imageRef": "af86cedd-e7d5-4a28-a810-f47830f4bffc", "flavorRef": "452", "networks": [{"uuid": "ff34e378-f58b-45e9-a487-b72107a8e88d"}]}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:12:53.765992 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.network.neutron [None req-f4246e5e-a80b-4720-bffe-0f7c7630f574 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] validate_networks() for [('ff34e378-f58b-45e9-a487-b72107a8e88d', None, None, None, None, None)] {{(pid=116749) validate_networks /opt/stack/nova/nova/network/neutron.py:2554}} Feb 09 13:12:53.769223 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f35db547-bb3f-49f2-ae4b-60b5f46ec983 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:53.781480 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f35db547-bb3f-49f2-ae4b-60b5f46ec983 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:53.784016 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f35db547-bb3f-49f2-ae4b-60b5f46ec983 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:53.785894 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-f35db547-bb3f-49f2-ae4b-60b5f46ec983 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1404 microversion: 2.20 time: 0.233138 Feb 09 13:12:53.788646 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 150/284] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:12:53 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1404 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:12:53.955398 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-9022a82d-f78e-4f58-b8ff-5bbd26fc70da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:53.956255 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-9022a82d-f78e-4f58-b8ff-5bbd26fc70da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:53.980164 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9022a82d-f78e-4f58-b8ff-5bbd26fc70da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:53.980982 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9022a82d-f78e-4f58-b8ff-5bbd26fc70da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:53.981915 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9022a82d-f78e-4f58-b8ff-5bbd26fc70da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:53.982467 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9022a82d-f78e-4f58-b8ff-5bbd26fc70da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:54.177330 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-9022a82d-f78e-4f58-b8ff-5bbd26fc70da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:54.188908 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-9022a82d-f78e-4f58-b8ff-5bbd26fc70da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1500 microversion: 2.1 time: 0.236937 Feb 09 13:12:54.200932 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 151/285] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:53 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1500 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:54.205771 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-62fe2942-3cde-4afb-baa6-5f256208856c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:54.206644 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-62fe2942-3cde-4afb-baa6-5f256208856c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:54.220335 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-62fe2942-3cde-4afb-baa6-5f256208856c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:54.224683 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-62fe2942-3cde-4afb-baa6-5f256208856c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:54.224683 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-62fe2942-3cde-4afb-baa6-5f256208856c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:54.224683 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-62fe2942-3cde-4afb-baa6-5f256208856c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:54.379050 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-62fe2942-3cde-4afb-baa6-5f256208856c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:54.388546 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-62fe2942-3cde-4afb-baa6-5f256208856c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1514 microversion: 2.1 time: 0.185347 Feb 09 13:12:54.389607 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 152/286] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:54 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:54.391919 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-f4246e5e-a80b-4720-bffe-0f7c7630f574 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Flavor limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 09 13:12:54.392534 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-f4246e5e-a80b-4720-bffe-0f7c7630f574 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Image limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 09 13:12:54.393192 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-f4246e5e-a80b-4720-bffe-0f7c7630f574 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Flavor pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 09 13:12:54.393740 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-f4246e5e-a80b-4720-bffe-0f7c7630f574 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Image pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 09 13:12:54.394277 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-f4246e5e-a80b-4720-bffe-0f7c7630f574 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 09 13:12:54.409630 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f4246e5e-a80b-4720-bffe-0f7c7630f574 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:54.410037 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f4246e5e-a80b-4720-bffe-0f7c7630f574 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:54.411195 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f4246e5e-a80b-4720-bffe-0f7c7630f574 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:54.411650 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f4246e5e-a80b-4720-bffe-0f7c7630f574 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:54.432460 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-f4246e5e-a80b-4720-bffe-0f7c7630f574 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Getting quotas for project a0e498b288c5455ea4e270d16d92dc89. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:12:54.437399 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-f4246e5e-a80b-4720-bffe-0f7c7630f574 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Getting quotas for user 39ee736e50d340be8da8586ee48fc7b5 and project a0e498b288c5455ea4e270d16d92dc89. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:12:54.450248 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-f4246e5e-a80b-4720-bffe-0f7c7630f574 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Going to run 1 instances... {{(pid=116749) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 09 13:12:54.453190 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-f4246e5e-a80b-4720-bffe-0f7c7630f574 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af86cedd-e7d5-4a28-a810-f47830f4bffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 09 13:12:54.586039 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-f4246e5e-a80b-4720-bffe-0f7c7630f574 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899427 Feb 09 13:12:54.586791 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 135/287] 10.222.0.84 () {60 vars in 1146 bytes} [Wed Feb 9 13:12:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 09 13:12:54.596604 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-bc1cb7e9-2bca-47d2-86e7-d91f3d39ada5 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:54.597909 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-bc1cb7e9-2bca-47d2-86e7-d91f3d39ada5 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:54.698519 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-bc1cb7e9-2bca-47d2-86e7-d91f3d39ada5 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:54.707591 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-bc1cb7e9-2bca-47d2-86e7-d91f3d39ada5 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1218 microversion: 2.1 time: 0.114500 Feb 09 13:12:54.708435 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 153/288] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:54 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:54.808618 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-1a93d268-c296-445c-befb-02c4780fb095 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:54.812515 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-1a93d268-c296-445c-befb-02c4780fb095 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:54.815700 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1a93d268-c296-445c-befb-02c4780fb095 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:54.818246 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1a93d268-c296-445c-befb-02c4780fb095 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:54.819348 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1a93d268-c296-445c-befb-02c4780fb095 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:54.819928 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1a93d268-c296-445c-befb-02c4780fb095 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:55.022373 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-1a93d268-c296-445c-befb-02c4780fb095 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:55.033434 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-1a93d268-c296-445c-befb-02c4780fb095 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:55.040339 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-1a93d268-c296-445c-befb-02c4780fb095 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:55.041991 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-1a93d268-c296-445c-befb-02c4780fb095 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1404 microversion: 2.20 time: 0.239140 Feb 09 13:12:55.043352 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 136/289] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:12:54 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1404 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:12:55.574577 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-74352b9e-c942-4f88-85f4-36c18cba054b req-57825e96-c8f9-4dec-a4ad-4a10a64e59b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267a95df-7ddb-4e9c-a629-4fc26b9c9843", "name": "network-vif-plugged", "status": "completed", "tag": "45e332d3-92b6-4aa9-9b18-a8fa5ca22e31"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:12:55.576164 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:12:55.576164 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:12:55.583871 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-74352b9e-c942-4f88-85f4-36c18cba054b req-57825e96-c8f9-4dec-a4ad-4a10a64e59b5 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:55.584571 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-74352b9e-c942-4f88-85f4-36c18cba054b req-57825e96-c8f9-4dec-a4ad-4a10a64e59b5 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:55.603341 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-74352b9e-c942-4f88-85f4-36c18cba054b req-57825e96-c8f9-4dec-a4ad-4a10a64e59b5 service nova] Creating event network-vif-plugged:45e332d3-92b6-4aa9-9b18-a8fa5ca22e31 for instance 267a95df-7ddb-4e9c-a629-4fc26b9c9843 on hv-cinder-82786 Feb 09 13:12:55.608466 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-74352b9e-c942-4f88-85f4-36c18cba054b req-57825e96-c8f9-4dec-a4ad-4a10a64e59b5 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038100 Feb 09 13:12:55.609288 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 154/290] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:12:55.724677 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-0dc75942-4e49-4eb1-ba8f-c09a7accbf23 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:55.725841 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-0dc75942-4e49-4eb1-ba8f-c09a7accbf23 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:55.732408 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0dc75942-4e49-4eb1-ba8f-c09a7accbf23 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:55.733211 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0dc75942-4e49-4eb1-ba8f-c09a7accbf23 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:55.733632 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0dc75942-4e49-4eb1-ba8f-c09a7accbf23 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:55.734059 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0dc75942-4e49-4eb1-ba8f-c09a7accbf23 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:55.792103 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-0dc75942-4e49-4eb1-ba8f-c09a7accbf23 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:55.799113 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-0dc75942-4e49-4eb1-ba8f-c09a7accbf23 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1222 microversion: 2.1 time: 0.078223 Feb 09 13:12:55.799668 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 137/291] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:55 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1222 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:56.060479 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-17829daf-0d11-41d1-bfb1-fdfd7a55baf3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:56.061183 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-17829daf-0d11-41d1-bfb1-fdfd7a55baf3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:56.067423 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-17829daf-0d11-41d1-bfb1-fdfd7a55baf3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:56.067959 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-17829daf-0d11-41d1-bfb1-fdfd7a55baf3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:56.068837 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-17829daf-0d11-41d1-bfb1-fdfd7a55baf3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:56.069467 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-17829daf-0d11-41d1-bfb1-fdfd7a55baf3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:56.206242 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-17829daf-0d11-41d1-bfb1-fdfd7a55baf3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:56.214928 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-17829daf-0d11-41d1-bfb1-fdfd7a55baf3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:56.216560 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-17829daf-0d11-41d1-bfb1-fdfd7a55baf3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:56.218264 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-17829daf-0d11-41d1-bfb1-fdfd7a55baf3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1404 microversion: 2.20 time: 0.161276 Feb 09 13:12:56.218264 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 155/292] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:12:56 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:12:56.816166 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-fbc28469-1ed6-4702-9069-5bea32ef0a8d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:56.816690 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-fbc28469-1ed6-4702-9069-5bea32ef0a8d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:56.822967 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-fbc28469-1ed6-4702-9069-5bea32ef0a8d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:56.823416 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-fbc28469-1ed6-4702-9069-5bea32ef0a8d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:56.824194 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-fbc28469-1ed6-4702-9069-5bea32ef0a8d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:56.824627 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-fbc28469-1ed6-4702-9069-5bea32ef0a8d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:56.882179 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-fbc28469-1ed6-4702-9069-5bea32ef0a8d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:56.889283 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-fbc28469-1ed6-4702-9069-5bea32ef0a8d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1222 microversion: 2.1 time: 0.076920 Feb 09 13:12:56.889849 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 138/293] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:56 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:57.247695 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-67d84cc3-eb2c-4f53-8fe8-ac37f470a4e6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:57.249069 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-67d84cc3-eb2c-4f53-8fe8-ac37f470a4e6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:57.257286 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-67d84cc3-eb2c-4f53-8fe8-ac37f470a4e6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:57.258626 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-67d84cc3-eb2c-4f53-8fe8-ac37f470a4e6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:57.259646 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-67d84cc3-eb2c-4f53-8fe8-ac37f470a4e6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:57.260325 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-67d84cc3-eb2c-4f53-8fe8-ac37f470a4e6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:57.469719 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-67d84cc3-eb2c-4f53-8fe8-ac37f470a4e6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:57.488005 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-67d84cc3-eb2c-4f53-8fe8-ac37f470a4e6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:57.490048 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-67d84cc3-eb2c-4f53-8fe8-ac37f470a4e6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:57.491589 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-67d84cc3-eb2c-4f53-8fe8-ac37f470a4e6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1404 microversion: 2.20 time: 0.247719 Feb 09 13:12:57.493204 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 156/294] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:12:57 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1404 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:12:57.905874 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-e9371fa2-6edc-43e5-8d31-6a4183aaf702 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:57.906484 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-e9371fa2-6edc-43e5-8d31-6a4183aaf702 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:57.913422 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e9371fa2-6edc-43e5-8d31-6a4183aaf702 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:57.913877 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e9371fa2-6edc-43e5-8d31-6a4183aaf702 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:57.914761 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e9371fa2-6edc-43e5-8d31-6a4183aaf702 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:57.915548 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e9371fa2-6edc-43e5-8d31-6a4183aaf702 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:57.994141 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-e9371fa2-6edc-43e5-8d31-6a4183aaf702 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:58.003552 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-e9371fa2-6edc-43e5-8d31-6a4183aaf702 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1270 microversion: 2.1 time: 0.101422 Feb 09 13:12:58.015069 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 139/295] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:57 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:58.509684 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-cc38f04e-7d68-4cea-b14f-408fcc23836b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:58.510243 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-cc38f04e-7d68-4cea-b14f-408fcc23836b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:58.516528 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cc38f04e-7d68-4cea-b14f-408fcc23836b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:58.516979 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cc38f04e-7d68-4cea-b14f-408fcc23836b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:58.517763 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cc38f04e-7d68-4cea-b14f-408fcc23836b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:58.518202 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cc38f04e-7d68-4cea-b14f-408fcc23836b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:58.650238 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-cc38f04e-7d68-4cea-b14f-408fcc23836b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:58.657903 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-cc38f04e-7d68-4cea-b14f-408fcc23836b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:58.659467 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-cc38f04e-7d68-4cea-b14f-408fcc23836b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:58.660564 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-cc38f04e-7d68-4cea-b14f-408fcc23836b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1404 microversion: 2.20 time: 0.155227 Feb 09 13:12:58.661110 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 157/296] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:12:58 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:12:59.025095 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-660294ad-5887-45f7-83d5-747981b0919c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:59.025697 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-660294ad-5887-45f7-83d5-747981b0919c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:59.032126 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-660294ad-5887-45f7-83d5-747981b0919c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:59.032574 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-660294ad-5887-45f7-83d5-747981b0919c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:59.033351 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-660294ad-5887-45f7-83d5-747981b0919c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:59.033790 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-660294ad-5887-45f7-83d5-747981b0919c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:59.092330 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-660294ad-5887-45f7-83d5-747981b0919c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:59.099571 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-660294ad-5887-45f7-83d5-747981b0919c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1270 microversion: 2.1 time: 0.078323 Feb 09 13:12:59.100132 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 140/297] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:12:59 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1270 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:12:59.679354 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-5edba1d6-9b68-4f83-a366-a29a85ee90fb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:12:59.681777 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-5edba1d6-9b68-4f83-a366-a29a85ee90fb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:12:59.690139 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5edba1d6-9b68-4f83-a366-a29a85ee90fb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:59.690749 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5edba1d6-9b68-4f83-a366-a29a85ee90fb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:59.691634 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5edba1d6-9b68-4f83-a366-a29a85ee90fb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:12:59.692069 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5edba1d6-9b68-4f83-a366-a29a85ee90fb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:12:59.867323 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-5edba1d6-9b68-4f83-a366-a29a85ee90fb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:59.875727 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-5edba1d6-9b68-4f83-a366-a29a85ee90fb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:59.877252 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-5edba1d6-9b68-4f83-a366-a29a85ee90fb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:12:59.878388 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-5edba1d6-9b68-4f83-a366-a29a85ee90fb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1404 microversion: 2.20 time: 0.204112 Feb 09 13:12:59.878995 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 158/298] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:12:59 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1404 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:13:00.117208 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d40cc1a6-33da-4945-8636-9ea0cd10916d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:00.117961 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d40cc1a6-33da-4945-8636-9ea0cd10916d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:00.125254 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d40cc1a6-33da-4945-8636-9ea0cd10916d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:00.125714 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d40cc1a6-33da-4945-8636-9ea0cd10916d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:00.126531 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d40cc1a6-33da-4945-8636-9ea0cd10916d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:00.127009 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d40cc1a6-33da-4945-8636-9ea0cd10916d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:00.204977 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-d40cc1a6-33da-4945-8636-9ea0cd10916d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:00.222753 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d40cc1a6-33da-4945-8636-9ea0cd10916d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1270 microversion: 2.1 time: 0.109500 Feb 09 13:13:00.223466 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 141/299] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:00 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1270 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:00.898253 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-52c4db62-10d7-4324-9220-fefc2a595c16 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:00.899999 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-52c4db62-10d7-4324-9220-fefc2a595c16 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:00.908646 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-52c4db62-10d7-4324-9220-fefc2a595c16 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:00.909103 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-52c4db62-10d7-4324-9220-fefc2a595c16 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:00.909902 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-52c4db62-10d7-4324-9220-fefc2a595c16 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:00.910471 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-52c4db62-10d7-4324-9220-fefc2a595c16 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:01.072698 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-52c4db62-10d7-4324-9220-fefc2a595c16 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:01.081992 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-52c4db62-10d7-4324-9220-fefc2a595c16 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:01.083823 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-52c4db62-10d7-4324-9220-fefc2a595c16 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:01.084860 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-52c4db62-10d7-4324-9220-fefc2a595c16 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1404 microversion: 2.20 time: 0.190633 Feb 09 13:13:01.085419 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 159/300] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:13:00 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1404 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:13:01.239353 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-aedf9d68-1fab-4ea7-9194-3cb54d7f93c1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:01.240848 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-aedf9d68-1fab-4ea7-9194-3cb54d7f93c1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:01.251577 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-aedf9d68-1fab-4ea7-9194-3cb54d7f93c1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:01.251577 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-aedf9d68-1fab-4ea7-9194-3cb54d7f93c1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:01.251577 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-aedf9d68-1fab-4ea7-9194-3cb54d7f93c1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:01.251577 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-aedf9d68-1fab-4ea7-9194-3cb54d7f93c1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:01.319382 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-aedf9d68-1fab-4ea7-9194-3cb54d7f93c1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:01.328271 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-aedf9d68-1fab-4ea7-9194-3cb54d7f93c1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1270 microversion: 2.1 time: 0.092585 Feb 09 13:13:01.329469 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 142/301] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:01 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:01.704851 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-86b363a5-3fba-4a9b-96ad-5122ee4607cd tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:13:01.705875 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-86b363a5-3fba-4a9b-96ad-5122ee4607cd tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:01.712874 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-86b363a5-3fba-4a9b-96ad-5122ee4607cd tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:01.713530 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-86b363a5-3fba-4a9b-96ad-5122ee4607cd tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:01.714741 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-86b363a5-3fba-4a9b-96ad-5122ee4607cd tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:01.715329 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-86b363a5-3fba-4a9b-96ad-5122ee4607cd tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:01.776232 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-86b363a5-3fba-4a9b-96ad-5122ee4607cd tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lazy-loading 'flavor' on Instance uuid 6851d5fe-b010-49cc-8696-19a1008c2beb {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:13:02.104607 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c4b7effb-eec2-4feb-aa71-de6cdbf5efda tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:02.105623 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-c4b7effb-eec2-4feb-aa71-de6cdbf5efda tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:02.112628 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c4b7effb-eec2-4feb-aa71-de6cdbf5efda tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:02.113184 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c4b7effb-eec2-4feb-aa71-de6cdbf5efda tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:02.114272 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c4b7effb-eec2-4feb-aa71-de6cdbf5efda tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:02.114981 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c4b7effb-eec2-4feb-aa71-de6cdbf5efda tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:02.157099 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-86b363a5-3fba-4a9b-96ad-5122ee4607cd tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "POST /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/action" status: 200 len: 32 microversion: 2.1 time: 0.456943 Feb 09 13:13:02.158741 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 160/302] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Feb 9 13:13:01 2022] POST /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/action => generated 32 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 09 13:13:02.170154 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-6354a668-1540-46c2-b718-a6aa0d64fb45 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:02.171220 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-6354a668-1540-46c2-b718-a6aa0d64fb45 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:02.183059 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6354a668-1540-46c2-b718-a6aa0d64fb45 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:02.189876 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6354a668-1540-46c2-b718-a6aa0d64fb45 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:02.189876 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6354a668-1540-46c2-b718-a6aa0d64fb45 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:02.189876 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6354a668-1540-46c2-b718-a6aa0d64fb45 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:02.454276 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c4b7effb-eec2-4feb-aa71-de6cdbf5efda tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:02.464626 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c4b7effb-eec2-4feb-aa71-de6cdbf5efda tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:02.466298 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c4b7effb-eec2-4feb-aa71-de6cdbf5efda tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:02.467571 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c4b7effb-eec2-4feb-aa71-de6cdbf5efda tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1404 microversion: 2.20 time: 0.367399 Feb 09 13:13:02.468299 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 143/303] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:13:02 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1404 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:13:02.472630 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-68bf822e-615c-4ceb-901a-a2ff58dff517 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:02.473432 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-68bf822e-615c-4ceb-901a-a2ff58dff517 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:02.530674 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-68bf822e-615c-4ceb-901a-a2ff58dff517 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:02.534190 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-68bf822e-615c-4ceb-901a-a2ff58dff517 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:02.535252 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-68bf822e-615c-4ceb-901a-a2ff58dff517 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:02.535709 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-68bf822e-615c-4ceb-901a-a2ff58dff517 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:02.667604 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6354a668-1540-46c2-b718-a6aa0d64fb45 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:02.675130 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-6354a668-1540-46c2-b718-a6aa0d64fb45 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.510768 Feb 09 13:13:02.684733 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 161/304] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:02 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:13:03.022425 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-68bf822e-615c-4ceb-901a-a2ff58dff517 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:03.032210 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-68bf822e-615c-4ceb-901a-a2ff58dff517 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1318 microversion: 2.1 time: 0.562859 Feb 09 13:13:03.033043 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 144/305] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:02 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1318 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:03.486313 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-e2bc7261-812d-4c9d-879a-991d79e4d635 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:03.487725 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-e2bc7261-812d-4c9d-879a-991d79e4d635 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:03.496323 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e2bc7261-812d-4c9d-879a-991d79e4d635 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:03.497138 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e2bc7261-812d-4c9d-879a-991d79e4d635 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:03.498245 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e2bc7261-812d-4c9d-879a-991d79e4d635 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:03.498944 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e2bc7261-812d-4c9d-879a-991d79e4d635 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:03.698060 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-5cd05597-8c12-4b03-9896-d797a2237931 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:03.700470 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-5cd05597-8c12-4b03-9896-d797a2237931 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:03.714624 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5cd05597-8c12-4b03-9896-d797a2237931 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:03.715480 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5cd05597-8c12-4b03-9896-d797a2237931 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:03.731055 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5cd05597-8c12-4b03-9896-d797a2237931 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:03.732208 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5cd05597-8c12-4b03-9896-d797a2237931 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:03.782766 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e2bc7261-812d-4c9d-879a-991d79e4d635 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:03.792393 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e2bc7261-812d-4c9d-879a-991d79e4d635 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:03.796463 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e2bc7261-812d-4c9d-879a-991d79e4d635 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:03.797905 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-e2bc7261-812d-4c9d-879a-991d79e4d635 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1596 microversion: 2.20 time: 0.316080 Feb 09 13:13:03.798645 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 162/306] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:13:03 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1596 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:13:03.831761 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-0ca073ef-0169-4d49-9c01-30a184e69feb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:03.832270 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-0ca073ef-0169-4d49-9c01-30a184e69feb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:03.850476 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0ca073ef-0169-4d49-9c01-30a184e69feb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:03.850476 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0ca073ef-0169-4d49-9c01-30a184e69feb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:03.851223 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0ca073ef-0169-4d49-9c01-30a184e69feb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:03.852358 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0ca073ef-0169-4d49-9c01-30a184e69feb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:04.007382 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-0ca073ef-0169-4d49-9c01-30a184e69feb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.184952 Feb 09 13:13:04.015352 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 163/307] 10.222.0.84 () {60 vars in 1315 bytes} [Wed Feb 9 13:13:03 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843/os-interface => generated 285 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 09 13:13:04.020699 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-5e664d94-97a4-4f93-83ae-2b413cd34a39 req-79cabfd0-30ae-46ff-88eb-a509f124548f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e5b30a-480d-4d7a-9944-88956c5cb510", "tag": "fa72bf8a-1dd4-4729-8ef4-fef9bf8861a1"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:13:04.025392 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:13:04.025392 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:13:04.034667 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-5e664d94-97a4-4f93-83ae-2b413cd34a39 req-79cabfd0-30ae-46ff-88eb-a509f124548f service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:04.035510 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-5e664d94-97a4-4f93-83ae-2b413cd34a39 req-79cabfd0-30ae-46ff-88eb-a509f124548f service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:04.050501 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-5e664d94-97a4-4f93-83ae-2b413cd34a39 req-79cabfd0-30ae-46ff-88eb-a509f124548f service nova] Creating event network-changed:fa72bf8a-1dd4-4729-8ef4-fef9bf8861a1 for instance 64e5b30a-480d-4d7a-9944-88956c5cb510 on hv-cinder-82786 Feb 09 13:13:04.061028 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-5e664d94-97a4-4f93-83ae-2b413cd34a39 req-79cabfd0-30ae-46ff-88eb-a509f124548f service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039046 Feb 09 13:13:04.076312 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 164/308] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:13:04.078866 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d369c66f-4db8-4579-9afa-5cb93c8b8ca7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:04.080284 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d369c66f-4db8-4579-9afa-5cb93c8b8ca7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:04.087069 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d369c66f-4db8-4579-9afa-5cb93c8b8ca7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:04.087666 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d369c66f-4db8-4579-9afa-5cb93c8b8ca7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:04.088631 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d369c66f-4db8-4579-9afa-5cb93c8b8ca7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:04.089196 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d369c66f-4db8-4579-9afa-5cb93c8b8ca7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:04.231857 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-5cd05597-8c12-4b03-9896-d797a2237931 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:04.240452 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-5cd05597-8c12-4b03-9896-d797a2237931 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.546699 Feb 09 13:13:04.241044 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 145/309] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:03 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:04.335631 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d369c66f-4db8-4579-9afa-5cb93c8b8ca7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:04.351558 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d369c66f-4db8-4579-9afa-5cb93c8b8ca7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1318 microversion: 2.1 time: 0.286093 Feb 09 13:13:04.353020 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 165/310] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:04 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:05.259603 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-914579c7-f98d-44f5-9a63-0c1476e5deb2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:05.260810 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-914579c7-f98d-44f5-9a63-0c1476e5deb2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:05.274280 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-914579c7-f98d-44f5-9a63-0c1476e5deb2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:05.278852 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-914579c7-f98d-44f5-9a63-0c1476e5deb2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:05.279911 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-914579c7-f98d-44f5-9a63-0c1476e5deb2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:05.282010 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-914579c7-f98d-44f5-9a63-0c1476e5deb2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:05.373276 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-b6eaccba-c211-4d5d-8bb8-d42617babfac tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:05.374537 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-b6eaccba-c211-4d5d-8bb8-d42617babfac tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:05.386278 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b6eaccba-c211-4d5d-8bb8-d42617babfac tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:05.387052 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b6eaccba-c211-4d5d-8bb8-d42617babfac tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:05.388020 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b6eaccba-c211-4d5d-8bb8-d42617babfac tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:05.388619 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b6eaccba-c211-4d5d-8bb8-d42617babfac tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:05.591601 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-b6eaccba-c211-4d5d-8bb8-d42617babfac tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:05.602306 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-b6eaccba-c211-4d5d-8bb8-d42617babfac tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1318 microversion: 2.1 time: 0.233016 Feb 09 13:13:05.604288 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 166/311] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:05 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:05.640037 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-914579c7-f98d-44f5-9a63-0c1476e5deb2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:05.649485 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-914579c7-f98d-44f5-9a63-0c1476e5deb2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.395163 Feb 09 13:13:05.650488 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 146/312] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:05 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:06.620330 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-31ba740f-7f40-4cf6-9ff7-d876fa16feb6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:06.621742 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-31ba740f-7f40-4cf6-9ff7-d876fa16feb6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:06.628457 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-31ba740f-7f40-4cf6-9ff7-d876fa16feb6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:06.628936 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-31ba740f-7f40-4cf6-9ff7-d876fa16feb6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:06.629692 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-31ba740f-7f40-4cf6-9ff7-d876fa16feb6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:06.630124 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-31ba740f-7f40-4cf6-9ff7-d876fa16feb6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:06.669075 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-35304f92-cfe6-4016-8cc4-965e668065a5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:06.670429 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-35304f92-cfe6-4016-8cc4-965e668065a5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:06.701847 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-35304f92-cfe6-4016-8cc4-965e668065a5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:06.702624 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-35304f92-cfe6-4016-8cc4-965e668065a5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:06.703739 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-35304f92-cfe6-4016-8cc4-965e668065a5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:06.709582 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-35304f92-cfe6-4016-8cc4-965e668065a5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:06.885920 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-31ba740f-7f40-4cf6-9ff7-d876fa16feb6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:06.897262 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-31ba740f-7f40-4cf6-9ff7-d876fa16feb6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1318 microversion: 2.1 time: 0.280755 Feb 09 13:13:06.900975 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 167/313] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:06 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:13:07.366903 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-35304f92-cfe6-4016-8cc4-965e668065a5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:07.368356 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-04430dd0-1e78-4dea-9dd3-2d0b771e442b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:07.369620 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-04430dd0-1e78-4dea-9dd3-2d0b771e442b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:07.374457 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-35304f92-cfe6-4016-8cc4-965e668065a5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.711290 Feb 09 13:13:07.379213 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 147/314] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:06 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:07.381870 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-04430dd0-1e78-4dea-9dd3-2d0b771e442b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:07.385233 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-04430dd0-1e78-4dea-9dd3-2d0b771e442b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:07.386267 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-04430dd0-1e78-4dea-9dd3-2d0b771e442b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:07.387062 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-04430dd0-1e78-4dea-9dd3-2d0b771e442b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:07.393158 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-9335e147-8d3a-443d-8573-367c055911a0 req-850de1ef-f922-4c74-bc9e-a831aea68be6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267a95df-7ddb-4e9c-a629-4fc26b9c9843", "tag": "45e332d3-92b6-4aa9-9b18-a8fa5ca22e31"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:13:07.395344 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:13:07.395344 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:13:07.410391 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-9335e147-8d3a-443d-8573-367c055911a0 req-850de1ef-f922-4c74-bc9e-a831aea68be6 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:07.411686 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-9335e147-8d3a-443d-8573-367c055911a0 req-850de1ef-f922-4c74-bc9e-a831aea68be6 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:07.435905 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-9335e147-8d3a-443d-8573-367c055911a0 req-850de1ef-f922-4c74-bc9e-a831aea68be6 service nova] Creating event network-changed:45e332d3-92b6-4aa9-9b18-a8fa5ca22e31 for instance 267a95df-7ddb-4e9c-a629-4fc26b9c9843 on hv-cinder-82786 Feb 09 13:13:07.442255 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-9335e147-8d3a-443d-8573-367c055911a0 req-850de1ef-f922-4c74-bc9e-a831aea68be6 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053266 Feb 09 13:13:07.444293 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 148/315] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:13:07.604953 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-04430dd0-1e78-4dea-9dd3-2d0b771e442b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:07.619574 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-04430dd0-1e78-4dea-9dd3-2d0b771e442b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:07.621112 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-04430dd0-1e78-4dea-9dd3-2d0b771e442b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:07.622347 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-04430dd0-1e78-4dea-9dd3-2d0b771e442b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1596 microversion: 2.20 time: 0.258029 Feb 09 13:13:07.623426 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 168/316] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:13:07 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1596 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:13:07.917408 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c3a07223-5013-4bdf-ad23-487f35e8b7e2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:07.918102 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-c3a07223-5013-4bdf-ad23-487f35e8b7e2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:07.924864 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c3a07223-5013-4bdf-ad23-487f35e8b7e2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:07.925660 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c3a07223-5013-4bdf-ad23-487f35e8b7e2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:07.926706 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c3a07223-5013-4bdf-ad23-487f35e8b7e2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:07.927309 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c3a07223-5013-4bdf-ad23-487f35e8b7e2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:08.119914 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c3a07223-5013-4bdf-ad23-487f35e8b7e2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:08.128110 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c3a07223-5013-4bdf-ad23-487f35e8b7e2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1318 microversion: 2.1 time: 0.214956 Feb 09 13:13:08.139007 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 149/317] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:07 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:08.395503 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-153654c2-0481-4e9b-a683-6ff2588fd0d0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:08.396842 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-153654c2-0481-4e9b-a683-6ff2588fd0d0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:08.403577 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-153654c2-0481-4e9b-a683-6ff2588fd0d0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:08.411192 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-153654c2-0481-4e9b-a683-6ff2588fd0d0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:08.411192 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-153654c2-0481-4e9b-a683-6ff2588fd0d0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:08.411192 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-153654c2-0481-4e9b-a683-6ff2588fd0d0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:08.551863 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-153654c2-0481-4e9b-a683-6ff2588fd0d0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:08.565320 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-153654c2-0481-4e9b-a683-6ff2588fd0d0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.170066 Feb 09 13:13:08.565320 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 169/318] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:08 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:13:08.641274 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8ccfb67b-ad0c-4c37-bfdb-3a73d6a017bd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:08.641811 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8ccfb67b-ad0c-4c37-bfdb-3a73d6a017bd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:08.647617 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8ccfb67b-ad0c-4c37-bfdb-3a73d6a017bd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:08.648068 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8ccfb67b-ad0c-4c37-bfdb-3a73d6a017bd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:08.648852 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8ccfb67b-ad0c-4c37-bfdb-3a73d6a017bd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:08.649562 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8ccfb67b-ad0c-4c37-bfdb-3a73d6a017bd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:08.793141 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8ccfb67b-ad0c-4c37-bfdb-3a73d6a017bd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:08.801308 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8ccfb67b-ad0c-4c37-bfdb-3a73d6a017bd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:08.802867 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8ccfb67b-ad0c-4c37-bfdb-3a73d6a017bd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:08.804040 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8ccfb67b-ad0c-4c37-bfdb-3a73d6a017bd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1596 microversion: 2.20 time: 0.166593 Feb 09 13:13:08.804604 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 150/319] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:13:08 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1596 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:13:09.145598 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-65aa3f32-bc93-4553-8065-03d6be8d5d32 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:09.147028 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-65aa3f32-bc93-4553-8065-03d6be8d5d32 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:09.153944 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-65aa3f32-bc93-4553-8065-03d6be8d5d32 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:09.154659 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-65aa3f32-bc93-4553-8065-03d6be8d5d32 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:09.155467 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-65aa3f32-bc93-4553-8065-03d6be8d5d32 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:09.155917 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-65aa3f32-bc93-4553-8065-03d6be8d5d32 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:09.433892 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-65aa3f32-bc93-4553-8065-03d6be8d5d32 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:09.442536 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-65aa3f32-bc93-4553-8065-03d6be8d5d32 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1318 microversion: 2.1 time: 0.300905 Feb 09 13:13:09.443562 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 170/320] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:09 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:09.578495 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-095a1695-eeb9-4df0-a0d7-f288580752da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:09.579139 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-095a1695-eeb9-4df0-a0d7-f288580752da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:09.585366 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-095a1695-eeb9-4df0-a0d7-f288580752da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:09.585879 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-095a1695-eeb9-4df0-a0d7-f288580752da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:09.586699 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-095a1695-eeb9-4df0-a0d7-f288580752da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:09.587141 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-095a1695-eeb9-4df0-a0d7-f288580752da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:09.756781 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-095a1695-eeb9-4df0-a0d7-f288580752da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:09.764432 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-095a1695-eeb9-4df0-a0d7-f288580752da tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.189709 Feb 09 13:13:09.766651 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 151/321] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:09 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:09.824825 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-410b1dc7-833f-4292-a431-ff4bba318e50 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:09.826543 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-410b1dc7-833f-4292-a431-ff4bba318e50 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:09.840335 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-410b1dc7-833f-4292-a431-ff4bba318e50 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:09.842471 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-410b1dc7-833f-4292-a431-ff4bba318e50 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:09.844240 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-410b1dc7-833f-4292-a431-ff4bba318e50 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:09.844862 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-410b1dc7-833f-4292-a431-ff4bba318e50 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:10.285492 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-410b1dc7-833f-4292-a431-ff4bba318e50 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:10.293664 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-410b1dc7-833f-4292-a431-ff4bba318e50 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:10.295394 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-410b1dc7-833f-4292-a431-ff4bba318e50 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:10.296625 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-410b1dc7-833f-4292-a431-ff4bba318e50 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1596 microversion: 2.20 time: 0.476276 Feb 09 13:13:10.297269 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 171/322] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:13:09 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1596 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:13:10.461210 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-2639a85b-25cb-40ed-a811-66b36284e6a1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:10.461823 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-2639a85b-25cb-40ed-a811-66b36284e6a1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:10.468270 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2639a85b-25cb-40ed-a811-66b36284e6a1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:10.471912 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2639a85b-25cb-40ed-a811-66b36284e6a1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:10.471912 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2639a85b-25cb-40ed-a811-66b36284e6a1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:10.471912 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2639a85b-25cb-40ed-a811-66b36284e6a1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:10.716928 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-2639a85b-25cb-40ed-a811-66b36284e6a1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:10.731460 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-2639a85b-25cb-40ed-a811-66b36284e6a1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1318 microversion: 2.1 time: 0.273827 Feb 09 13:13:10.747448 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 152/323] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:10 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:10.787197 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-b3693af1-08b1-4488-bedb-09fc15e90745 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:10.788227 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-b3693af1-08b1-4488-bedb-09fc15e90745 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:10.813302 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b3693af1-08b1-4488-bedb-09fc15e90745 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:10.814165 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b3693af1-08b1-4488-bedb-09fc15e90745 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:10.815994 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b3693af1-08b1-4488-bedb-09fc15e90745 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:10.816735 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b3693af1-08b1-4488-bedb-09fc15e90745 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:11.177612 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-b3693af1-08b1-4488-bedb-09fc15e90745 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:11.186362 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-b3693af1-08b1-4488-bedb-09fc15e90745 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.407042 Feb 09 13:13:11.196652 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 172/324] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:10 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:11.315777 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-5b780e9d-1ee5-492e-9a46-fb5ed80b71b9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:11.316392 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-5b780e9d-1ee5-492e-9a46-fb5ed80b71b9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:11.328659 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5b780e9d-1ee5-492e-9a46-fb5ed80b71b9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:11.330323 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5b780e9d-1ee5-492e-9a46-fb5ed80b71b9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:11.331420 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5b780e9d-1ee5-492e-9a46-fb5ed80b71b9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:11.332679 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5b780e9d-1ee5-492e-9a46-fb5ed80b71b9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:11.693101 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-5b780e9d-1ee5-492e-9a46-fb5ed80b71b9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:11.708549 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-5b780e9d-1ee5-492e-9a46-fb5ed80b71b9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:11.710210 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-5b780e9d-1ee5-492e-9a46-fb5ed80b71b9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:11.711445 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-5b780e9d-1ee5-492e-9a46-fb5ed80b71b9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1596 microversion: 2.20 time: 0.400329 Feb 09 13:13:11.721826 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 153/325] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:13:11 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1596 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:13:11.748965 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-884efc3c-4d1a-4a9c-afe5-d79b09a2477c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:11.749567 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-884efc3c-4d1a-4a9c-afe5-d79b09a2477c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:11.758794 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-884efc3c-4d1a-4a9c-afe5-d79b09a2477c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:11.759246 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-884efc3c-4d1a-4a9c-afe5-d79b09a2477c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:11.760059 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-884efc3c-4d1a-4a9c-afe5-d79b09a2477c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:11.760477 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-884efc3c-4d1a-4a9c-afe5-d79b09a2477c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:12.207279 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-bc62ade8-9443-4b04-8c1b-8a6885bdb619 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:12.209012 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-bc62ade8-9443-4b04-8c1b-8a6885bdb619 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:12.224170 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bc62ade8-9443-4b04-8c1b-8a6885bdb619 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:12.225095 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bc62ade8-9443-4b04-8c1b-8a6885bdb619 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:12.226858 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bc62ade8-9443-4b04-8c1b-8a6885bdb619 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:12.227633 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bc62ade8-9443-4b04-8c1b-8a6885bdb619 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:12.408283 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-884efc3c-4d1a-4a9c-afe5-d79b09a2477c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:12.418716 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-884efc3c-4d1a-4a9c-afe5-d79b09a2477c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1318 microversion: 2.1 time: 0.673336 Feb 09 13:13:12.419298 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 173/326] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:11 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1318 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:12.610225 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-bc62ade8-9443-4b04-8c1b-8a6885bdb619 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:12.622049 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-bc62ade8-9443-4b04-8c1b-8a6885bdb619 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.421892 Feb 09 13:13:12.626471 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 154/327] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:12 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:12.729995 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-cc475be0-00d7-4573-a213-d1d45dff5c17 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:12.730892 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-cc475be0-00d7-4573-a213-d1d45dff5c17 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:12.736982 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cc475be0-00d7-4573-a213-d1d45dff5c17 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:12.737715 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cc475be0-00d7-4573-a213-d1d45dff5c17 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:12.738687 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cc475be0-00d7-4573-a213-d1d45dff5c17 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:12.739276 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cc475be0-00d7-4573-a213-d1d45dff5c17 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:13.206323 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-cc475be0-00d7-4573-a213-d1d45dff5c17 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:13.218025 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-cc475be0-00d7-4573-a213-d1d45dff5c17 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:13.219573 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-cc475be0-00d7-4573-a213-d1d45dff5c17 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:13.220753 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-cc475be0-00d7-4573-a213-d1d45dff5c17 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1715 microversion: 2.20 time: 0.495169 Feb 09 13:13:13.221307 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 174/328] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:13:12 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1715 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:13:13.239478 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-144ef518-3c21-41c4-b595-39b815a03212 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:13.250057 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-144ef518-3c21-41c4-b595-39b815a03212 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:13.250381 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-144ef518-3c21-41c4-b595-39b815a03212 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:13.251199 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-144ef518-3c21-41c4-b595-39b815a03212 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:13.252214 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-144ef518-3c21-41c4-b595-39b815a03212 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:13.252845 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-144ef518-3c21-41c4-b595-39b815a03212 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:13.281642 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-144ef518-3c21-41c4-b595-39b815a03212 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843/ips" status: 200 len: 152 microversion: 2.20 time: 0.046142 Feb 09 13:13:13.282224 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 155/329] 10.222.0.84 () {60 vars in 1288 bytes} [Wed Feb 9 13:13:13 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843/ips => generated 152 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 09 13:13:13.438137 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-2e2ce895-41a0-4be7-9738-0a0ae37342df tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:13.439153 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-2e2ce895-41a0-4be7-9738-0a0ae37342df tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:13.456101 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2e2ce895-41a0-4be7-9738-0a0ae37342df tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:13.459250 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2e2ce895-41a0-4be7-9738-0a0ae37342df tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:13.461004 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2e2ce895-41a0-4be7-9738-0a0ae37342df tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:13.464187 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2e2ce895-41a0-4be7-9738-0a0ae37342df tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:13.645997 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-b2253a47-c304-4569-8ca9-1ef84470b967 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:13.646868 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-b2253a47-c304-4569-8ca9-1ef84470b967 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:13.656866 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b2253a47-c304-4569-8ca9-1ef84470b967 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:13.659114 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b2253a47-c304-4569-8ca9-1ef84470b967 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:13.660132 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b2253a47-c304-4569-8ca9-1ef84470b967 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:13.663101 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b2253a47-c304-4569-8ca9-1ef84470b967 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:13.806153 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-2e2ce895-41a0-4be7-9738-0a0ae37342df tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:13.832898 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-2e2ce895-41a0-4be7-9738-0a0ae37342df tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1318 microversion: 2.1 time: 0.386378 Feb 09 13:13:13.833574 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 175/330] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:13 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:13.957300 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-b2253a47-c304-4569-8ca9-1ef84470b967 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:13.967153 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-b2253a47-c304-4569-8ca9-1ef84470b967 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.323862 Feb 09 13:13:13.976938 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 156/331] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:13 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:14.852474 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-73de84e9-c055-415d-b487-4b79cc4164c9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:14.853752 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-73de84e9-c055-415d-b487-4b79cc4164c9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:14.865633 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-73de84e9-c055-415d-b487-4b79cc4164c9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:14.869752 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-73de84e9-c055-415d-b487-4b79cc4164c9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:14.869752 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-73de84e9-c055-415d-b487-4b79cc4164c9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:14.869752 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-73de84e9-c055-415d-b487-4b79cc4164c9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:14.952774 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-e3d9d602-7338-4214-a2b3-45c066369f5d req-4caf1c0e-23c6-4ab9-b548-e2c733def3ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e5b30a-480d-4d7a-9944-88956c5cb510", "name": "network-vif-plugged", "status": "completed", "tag": "fa72bf8a-1dd4-4729-8ef4-fef9bf8861a1"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:13:14.954733 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:13:14.954733 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:13:14.972190 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-e3d9d602-7338-4214-a2b3-45c066369f5d req-4caf1c0e-23c6-4ab9-b548-e2c733def3ed service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:14.979287 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-e3d9d602-7338-4214-a2b3-45c066369f5d req-4caf1c0e-23c6-4ab9-b548-e2c733def3ed service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:14.995311 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-e3d9d602-7338-4214-a2b3-45c066369f5d req-4caf1c0e-23c6-4ab9-b548-e2c733def3ed service nova] Creating event network-vif-plugged:fa72bf8a-1dd4-4729-8ef4-fef9bf8861a1 for instance 64e5b30a-480d-4d7a-9944-88956c5cb510 on hv-cinder-82786 Feb 09 13:13:15.005546 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-e3d9d602-7338-4214-a2b3-45c066369f5d req-4caf1c0e-23c6-4ab9-b548-e2c733def3ed service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056339 Feb 09 13:13:15.008687 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 157/332] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:13:15.020744 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-a2b9c7c6-e91e-4340-825a-8a56c5bc6e34 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:15.021726 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-a2b9c7c6-e91e-4340-825a-8a56c5bc6e34 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:15.034915 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a2b9c7c6-e91e-4340-825a-8a56c5bc6e34 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:15.038885 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a2b9c7c6-e91e-4340-825a-8a56c5bc6e34 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:15.040279 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a2b9c7c6-e91e-4340-825a-8a56c5bc6e34 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:15.040721 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a2b9c7c6-e91e-4340-825a-8a56c5bc6e34 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:15.337441 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-a2b9c7c6-e91e-4340-825a-8a56c5bc6e34 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:15.346136 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-a2b9c7c6-e91e-4340-825a-8a56c5bc6e34 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.334060 Feb 09 13:13:15.346896 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 158/333] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:15 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:15.681114 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-73de84e9-c055-415d-b487-4b79cc4164c9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:15.692999 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-73de84e9-c055-415d-b487-4b79cc4164c9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1318 microversion: 2.1 time: 0.846184 Feb 09 13:13:15.703928 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 176/334] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:14 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1318 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:16.367286 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-be4ee2a5-f833-47b5-a310-56dc5b2e7bb4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:16.368977 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-be4ee2a5-f833-47b5-a310-56dc5b2e7bb4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:16.376984 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-be4ee2a5-f833-47b5-a310-56dc5b2e7bb4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:16.377532 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-be4ee2a5-f833-47b5-a310-56dc5b2e7bb4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:16.381360 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-be4ee2a5-f833-47b5-a310-56dc5b2e7bb4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:16.381900 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-be4ee2a5-f833-47b5-a310-56dc5b2e7bb4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:16.656300 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-be4ee2a5-f833-47b5-a310-56dc5b2e7bb4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:16.676569 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-be4ee2a5-f833-47b5-a310-56dc5b2e7bb4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.314332 Feb 09 13:13:16.679511 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 159/335] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:16 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:16.710497 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-620201aa-6261-4639-abe6-e95eae9fb4e5 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:16.712698 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-620201aa-6261-4639-abe6-e95eae9fb4e5 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:16.723561 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-620201aa-6261-4639-abe6-e95eae9fb4e5 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:16.724280 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-620201aa-6261-4639-abe6-e95eae9fb4e5 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:16.725322 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-620201aa-6261-4639-abe6-e95eae9fb4e5 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:16.725930 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-620201aa-6261-4639-abe6-e95eae9fb4e5 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:16.911463 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-620201aa-6261-4639-abe6-e95eae9fb4e5 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:16.924596 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-620201aa-6261-4639-abe6-e95eae9fb4e5 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1318 microversion: 2.1 time: 0.218691 Feb 09 13:13:16.929691 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 177/336] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:16 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:13:17.706325 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ccc79213-2e94-4899-bcc5-20670f328cc2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:17.708151 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-ccc79213-2e94-4899-bcc5-20670f328cc2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:17.721232 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ccc79213-2e94-4899-bcc5-20670f328cc2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:17.723651 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ccc79213-2e94-4899-bcc5-20670f328cc2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:17.727878 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ccc79213-2e94-4899-bcc5-20670f328cc2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:17.728426 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ccc79213-2e94-4899-bcc5-20670f328cc2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:17.930157 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ccc79213-2e94-4899-bcc5-20670f328cc2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:17.942126 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-ccc79213-2e94-4899-bcc5-20670f328cc2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.250100 Feb 09 13:13:17.943108 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 160/337] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:17 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:17.947593 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-eb9e565c-c85d-4dc6-8724-9a81b3c1944c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:17.952666 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-eb9e565c-c85d-4dc6-8724-9a81b3c1944c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:17.964281 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-eb9e565c-c85d-4dc6-8724-9a81b3c1944c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:17.964858 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-eb9e565c-c85d-4dc6-8724-9a81b3c1944c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:17.965812 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-eb9e565c-c85d-4dc6-8724-9a81b3c1944c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:17.966407 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-eb9e565c-c85d-4dc6-8724-9a81b3c1944c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:18.223082 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-eb9e565c-c85d-4dc6-8724-9a81b3c1944c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:18.238153 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-eb9e565c-c85d-4dc6-8724-9a81b3c1944c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1507 microversion: 2.1 time: 0.296962 Feb 09 13:13:18.238796 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 178/338] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:17 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1507 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:18.960050 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ae76f10d-0e73-496c-8875-e215fd5db86c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:18.960423 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-ae76f10d-0e73-496c-8875-e215fd5db86c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:18.969513 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ae76f10d-0e73-496c-8875-e215fd5db86c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:18.969965 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ae76f10d-0e73-496c-8875-e215fd5db86c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:18.973071 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ae76f10d-0e73-496c-8875-e215fd5db86c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:18.973626 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ae76f10d-0e73-496c-8875-e215fd5db86c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:19.305876 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ae76f10d-0e73-496c-8875-e215fd5db86c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:19.313209 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-ae76f10d-0e73-496c-8875-e215fd5db86c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.357068 Feb 09 13:13:19.326938 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 161/339] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:18 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:20.090919 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-7f2eb2d9-4739-4787-aaf7-4945826baa9f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b70b7ed9-6e4f-4de4-b3ba-1fe36f374333"}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:13:20.102347 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-7f2eb2d9-4739-4787-aaf7-4945826baa9f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:20.103333 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7f2eb2d9-4739-4787-aaf7-4945826baa9f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:20.103333 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7f2eb2d9-4739-4787-aaf7-4945826baa9f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:20.104782 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7f2eb2d9-4739-4787-aaf7-4945826baa9f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:20.105245 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7f2eb2d9-4739-4787-aaf7-4945826baa9f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:20.330330 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-e491764b-7a4d-4fad-b97f-ade2908dbfec tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:20.331584 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-e491764b-7a4d-4fad-b97f-ade2908dbfec tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:20.347132 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e491764b-7a4d-4fad-b97f-ade2908dbfec tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:20.349147 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e491764b-7a4d-4fad-b97f-ade2908dbfec tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:20.351712 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e491764b-7a4d-4fad-b97f-ade2908dbfec tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:20.352462 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e491764b-7a4d-4fad-b97f-ade2908dbfec tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:20.735105 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-e491764b-7a4d-4fad-b97f-ade2908dbfec tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:20.749275 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-e491764b-7a4d-4fad-b97f-ade2908dbfec tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.423276 Feb 09 13:13:20.752650 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 162/340] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:20 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:21.220965 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-7f2eb2d9-4739-4787-aaf7-4945826baa9f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "POST /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.133349 Feb 09 13:13:21.222109 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 179/341] 10.222.0.84 () {60 vars in 1322 bytes} [Wed Feb 9 13:13:20 2022] POST /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments => generated 194 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:13:21.774508 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-a611d8ce-d81d-45f1-88e7-be3de2201449 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:21.774508 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-a611d8ce-d81d-45f1-88e7-be3de2201449 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:21.781483 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a611d8ce-d81d-45f1-88e7-be3de2201449 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:21.782177 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a611d8ce-d81d-45f1-88e7-be3de2201449 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:21.784495 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a611d8ce-d81d-45f1-88e7-be3de2201449 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:21.784979 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a611d8ce-d81d-45f1-88e7-be3de2201449 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:22.120177 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-a611d8ce-d81d-45f1-88e7-be3de2201449 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:22.131941 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-a611d8ce-d81d-45f1-88e7-be3de2201449 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.368826 Feb 09 13:13:22.133165 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 163/342] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:21 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:23.076188 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-fb8a75f4-c1b1-4b0c-830f-794eac7602ba tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56c61a13-17da-4aee-9498-766997db5c07"}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:13:23.077821 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-fb8a75f4-c1b1-4b0c-830f-794eac7602ba tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:23.093937 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fb8a75f4-c1b1-4b0c-830f-794eac7602ba tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:23.094451 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fb8a75f4-c1b1-4b0c-830f-794eac7602ba tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:23.097845 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fb8a75f4-c1b1-4b0c-830f-794eac7602ba tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:23.097845 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fb8a75f4-c1b1-4b0c-830f-794eac7602ba tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:23.151707 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-12f1cd89-a7ba-410c-bf8b-0b675e286fc1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:23.152383 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-12f1cd89-a7ba-410c-bf8b-0b675e286fc1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:23.162481 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-12f1cd89-a7ba-410c-bf8b-0b675e286fc1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:23.165830 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-12f1cd89-a7ba-410c-bf8b-0b675e286fc1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:23.167976 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-12f1cd89-a7ba-410c-bf8b-0b675e286fc1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:23.169384 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-12f1cd89-a7ba-410c-bf8b-0b675e286fc1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:23.495900 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-12f1cd89-a7ba-410c-bf8b-0b675e286fc1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:23.510420 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-12f1cd89-a7ba-410c-bf8b-0b675e286fc1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.364323 Feb 09 13:13:23.524996 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 164/343] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:23 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:24.160424 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-fb8a75f4-c1b1-4b0c-830f-794eac7602ba tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "POST /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.089268 Feb 09 13:13:24.161477 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 180/344] 10.222.0.84 () {60 vars in 1322 bytes} [Wed Feb 9 13:13:23 2022] POST /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991/os-volume_attachments => generated 194 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:13:24.534738 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-501f655b-e6c9-4a19-96a6-4887d6e2fdf5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:24.535353 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-501f655b-e6c9-4a19-96a6-4887d6e2fdf5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:24.545847 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-501f655b-e6c9-4a19-96a6-4887d6e2fdf5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:24.546500 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-501f655b-e6c9-4a19-96a6-4887d6e2fdf5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:24.547768 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-501f655b-e6c9-4a19-96a6-4887d6e2fdf5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:24.548532 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-501f655b-e6c9-4a19-96a6-4887d6e2fdf5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:24.998426 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-501f655b-e6c9-4a19-96a6-4887d6e2fdf5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:25.009472 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-501f655b-e6c9-4a19-96a6-4887d6e2fdf5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.480996 Feb 09 13:13:25.010052 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 165/345] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:24 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:26.032349 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-b2a191d6-feb4-415d-b343-cd08ec2bece2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:26.032349 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-b2a191d6-feb4-415d-b343-cd08ec2bece2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:26.036073 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b2a191d6-feb4-415d-b343-cd08ec2bece2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:26.036528 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b2a191d6-feb4-415d-b343-cd08ec2bece2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:26.037333 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b2a191d6-feb4-415d-b343-cd08ec2bece2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:26.038187 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b2a191d6-feb4-415d-b343-cd08ec2bece2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:26.196070 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-b2a191d6-feb4-415d-b343-cd08ec2bece2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:26.206642 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-b2a191d6-feb4-415d-b343-cd08ec2bece2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.182436 Feb 09 13:13:26.206642 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 181/346] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:26 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:27.223968 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-2b67b773-67f7-43c5-84b5-128ff01a8892 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:27.224581 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-2b67b773-67f7-43c5-84b5-128ff01a8892 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:27.233257 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2b67b773-67f7-43c5-84b5-128ff01a8892 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:27.233727 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2b67b773-67f7-43c5-84b5-128ff01a8892 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:27.237490 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2b67b773-67f7-43c5-84b5-128ff01a8892 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:27.238692 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2b67b773-67f7-43c5-84b5-128ff01a8892 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:27.413872 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-2b67b773-67f7-43c5-84b5-128ff01a8892 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:27.422599 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-2b67b773-67f7-43c5-84b5-128ff01a8892 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.203744 Feb 09 13:13:27.424208 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 166/347] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:27 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:28.439969 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-66049c80-adbd-462b-b5f3-b76168cd9801 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:28.442768 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-66049c80-adbd-462b-b5f3-b76168cd9801 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:28.453310 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-66049c80-adbd-462b-b5f3-b76168cd9801 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:28.453905 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-66049c80-adbd-462b-b5f3-b76168cd9801 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:28.455768 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-66049c80-adbd-462b-b5f3-b76168cd9801 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:28.456491 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-66049c80-adbd-462b-b5f3-b76168cd9801 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:28.739827 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-66049c80-adbd-462b-b5f3-b76168cd9801 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:28.749632 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-66049c80-adbd-462b-b5f3-b76168cd9801 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1500 microversion: 2.1 time: 0.313363 Feb 09 13:13:28.762266 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 182/348] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:28 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1500 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:28.767941 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-f3f47b18-7056-4fa9-a0b2-84486daaaf6c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b4354eb-940f-464e-a5cf-e1828a805aa3"}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:13:28.769750 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-f3f47b18-7056-4fa9-a0b2-84486daaaf6c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:28.778065 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f3f47b18-7056-4fa9-a0b2-84486daaaf6c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:28.778822 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f3f47b18-7056-4fa9-a0b2-84486daaaf6c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:28.779806 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f3f47b18-7056-4fa9-a0b2-84486daaaf6c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:28.780406 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f3f47b18-7056-4fa9-a0b2-84486daaaf6c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:28.809133 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-f3f47b18-7056-4fa9-a0b2-84486daaaf6c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] HTTP exception thrown: Cannot 'attach_volume' instance 6851d5fe-b010-49cc-8696-19a1008c2beb while it is in vm_state rescued Feb 09 13:13:28.810007 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-f3f47b18-7056-4fa9-a0b2-84486daaaf6c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Returning 409 to user: Cannot 'attach_volume' instance 6851d5fe-b010-49cc-8696-19a1008c2beb while it is in vm_state rescued {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:13:28.811287 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-f3f47b18-7056-4fa9-a0b2-84486daaaf6c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "POST /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047539 Feb 09 13:13:28.821771 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-fdcb6fba-3488-4097-8fdd-1aa344f46320 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:13:28.825195 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-fdcb6fba-3488-4097-8fdd-1aa344f46320 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:28.827134 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 167/349] 10.222.0.84 () {60 vars in 1322 bytes} [Wed Feb 9 13:13:28 2022] POST /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/os-volume_attachments => generated 152 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 09 13:13:28.829693 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fdcb6fba-3488-4097-8fdd-1aa344f46320 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:28.830159 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fdcb6fba-3488-4097-8fdd-1aa344f46320 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:28.831006 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fdcb6fba-3488-4097-8fdd-1aa344f46320 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:28.831499 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fdcb6fba-3488-4097-8fdd-1aa344f46320 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:29.097304 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-fdcb6fba-3488-4097-8fdd-1aa344f46320 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "POST /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/action" status: 202 len: 0 microversion: 2.1 time: 0.280034 Feb 09 13:13:29.098183 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 183/350] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Feb 9 13:13:28 2022] POST /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 09 13:13:29.110981 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-9279dddd-8d59-4a90-a457-3f2238fe26b3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:29.111972 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-9279dddd-8d59-4a90-a457-3f2238fe26b3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:29.125721 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9279dddd-8d59-4a90-a457-3f2238fe26b3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:29.126743 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9279dddd-8d59-4a90-a457-3f2238fe26b3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:29.130241 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9279dddd-8d59-4a90-a457-3f2238fe26b3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:29.130241 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9279dddd-8d59-4a90-a457-3f2238fe26b3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:29.451408 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-9279dddd-8d59-4a90-a457-3f2238fe26b3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:29.469948 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-9279dddd-8d59-4a90-a457-3f2238fe26b3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1508 microversion: 2.1 time: 0.363323 Feb 09 13:13:29.480743 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 168/351] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:29 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1508 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:29.561807 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-e18aabda-80b7-4491-9b30-34c08744b8cc tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b70b7ed9-6e4f-4de4-b3ba-1fe36f374333"}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:13:29.566301 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-e18aabda-80b7-4491-9b30-34c08744b8cc tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:29.602668 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e18aabda-80b7-4491-9b30-34c08744b8cc tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:29.603517 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e18aabda-80b7-4491-9b30-34c08744b8cc tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:29.608049 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e18aabda-80b7-4491-9b30-34c08744b8cc tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:29.611204 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e18aabda-80b7-4491-9b30-34c08744b8cc tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:29.896334 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.wsgi [None req-e18aabda-80b7-4491-9b30-34c08744b8cc tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] HTTP exception thrown: Invalid volume: volume b70b7ed9-6e4f-4de4-b3ba-1fe36f374333 is already attached to instances: 64e5b30a-480d-4d7a-9944-88956c5cb510 Feb 09 13:13:29.896334 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-e18aabda-80b7-4491-9b30-34c08744b8cc tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Returning 400 to user: Invalid volume: volume b70b7ed9-6e4f-4de4-b3ba-1fe36f374333 is already attached to instances: 64e5b30a-480d-4d7a-9944-88956c5cb510 {{(pid=116748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:13:29.896334 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-e18aabda-80b7-4491-9b30-34c08744b8cc tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "POST /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.297083 Feb 09 13:13:29.896334 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 184/352] 10.222.0.84 () {60 vars in 1322 bytes} [Wed Feb 9 13:13:29 2022] POST /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments => generated 174 bytes in 300 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 09 13:13:30.492991 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ce23ee26-07d1-4fb1-95d9-55ace854f576 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:30.493749 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-ce23ee26-07d1-4fb1-95d9-55ace854f576 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:30.500722 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ce23ee26-07d1-4fb1-95d9-55ace854f576 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:30.501251 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ce23ee26-07d1-4fb1-95d9-55ace854f576 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:30.502041 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ce23ee26-07d1-4fb1-95d9-55ace854f576 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:30.502473 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ce23ee26-07d1-4fb1-95d9-55ace854f576 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:30.702230 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ce23ee26-07d1-4fb1-95d9-55ace854f576 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:30.710779 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-ce23ee26-07d1-4fb1-95d9-55ace854f576 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1508 microversion: 2.1 time: 0.225095 Feb 09 13:13:30.712197 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 169/353] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:30 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1508 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:30.938776 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-5f8ecd03-44aa-4a8f-9e8c-2d9f8106967e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:30.939951 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-5f8ecd03-44aa-4a8f-9e8c-2d9f8106967e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:30.948710 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5f8ecd03-44aa-4a8f-9e8c-2d9f8106967e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:30.949503 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5f8ecd03-44aa-4a8f-9e8c-2d9f8106967e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:30.950382 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5f8ecd03-44aa-4a8f-9e8c-2d9f8106967e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:30.951027 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5f8ecd03-44aa-4a8f-9e8c-2d9f8106967e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:31.727995 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-86c2ed88-b8b2-42f2-96b7-e70dbc0feb72 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:31.729342 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-86c2ed88-b8b2-42f2-96b7-e70dbc0feb72 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:31.735757 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-86c2ed88-b8b2-42f2-96b7-e70dbc0feb72 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:31.736606 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-86c2ed88-b8b2-42f2-96b7-e70dbc0feb72 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:31.737583 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-86c2ed88-b8b2-42f2-96b7-e70dbc0feb72 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:31.738188 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-86c2ed88-b8b2-42f2-96b7-e70dbc0feb72 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:31.919676 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-5f8ecd03-44aa-4a8f-9e8c-2d9f8106967e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lazy-loading 'services' on Instance uuid 64e5b30a-480d-4d7a-9944-88956c5cb510 {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:13:32.057115 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-86c2ed88-b8b2-42f2-96b7-e70dbc0feb72 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:32.064861 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-86c2ed88-b8b2-42f2-96b7-e70dbc0feb72 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1508 microversion: 2.1 time: 0.340936 Feb 09 13:13:32.080020 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 170/354] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:31 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1508 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:13:32.282651 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-5f8ecd03-44aa-4a8f-9e8c-2d9f8106967e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "DELETE /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments/b70b7ed9-6e4f-4de4-b3ba-1fe36f374333" status: 202 len: 0 microversion: 2.1 time: 1.346045 Feb 09 13:13:32.285114 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 185/355] 10.222.0.84 () {58 vars in 1415 bytes} [Wed Feb 9 13:13:30 2022] DELETE /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments/b70b7ed9-6e4f-4de4-b3ba-1fe36f374333 => generated 0 bytes in 1352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:13:32.297675 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-1eab2569-53dc-44c1-a18a-8331437c4db4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:32.298628 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-1eab2569-53dc-44c1-a18a-8331437c4db4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:32.305511 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1eab2569-53dc-44c1-a18a-8331437c4db4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:32.310145 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1eab2569-53dc-44c1-a18a-8331437c4db4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:32.310145 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1eab2569-53dc-44c1-a18a-8331437c4db4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:32.310145 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1eab2569-53dc-44c1-a18a-8331437c4db4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:32.338695 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-1eab2569-53dc-44c1-a18a-8331437c4db4 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044733 Feb 09 13:13:32.339266 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 171/356] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:13:32 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:13:33.088216 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-32439daf-1ecb-40a4-b8fd-c3f5116175d9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:33.088966 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-32439daf-1ecb-40a4-b8fd-c3f5116175d9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:33.103812 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-32439daf-1ecb-40a4-b8fd-c3f5116175d9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:33.105483 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-32439daf-1ecb-40a4-b8fd-c3f5116175d9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:33.106446 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-32439daf-1ecb-40a4-b8fd-c3f5116175d9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:33.111217 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-32439daf-1ecb-40a4-b8fd-c3f5116175d9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:33.341705 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-32439daf-1ecb-40a4-b8fd-c3f5116175d9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:33.350885 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-6a9911c5-6dc9-4596-aa67-28c6183fd3a7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:33.352031 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-6a9911c5-6dc9-4596-aa67-28c6183fd3a7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:33.352326 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-32439daf-1ecb-40a4-b8fd-c3f5116175d9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1514 microversion: 2.1 time: 0.268003 Feb 09 13:13:33.353631 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 186/357] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:33 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1514 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:33.368123 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6a9911c5-6dc9-4596-aa67-28c6183fd3a7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:33.369766 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6a9911c5-6dc9-4596-aa67-28c6183fd3a7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:33.371754 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6a9911c5-6dc9-4596-aa67-28c6183fd3a7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:33.372485 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6a9911c5-6dc9-4596-aa67-28c6183fd3a7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:33.436632 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-6a9911c5-6dc9-4596-aa67-28c6183fd3a7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090628 Feb 09 13:13:33.438982 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 172/358] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:13:33 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:13:34.452196 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-3c83b0af-ee7e-468d-a5d7-34acfa96812b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:34.454336 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-3c83b0af-ee7e-468d-a5d7-34acfa96812b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:34.463168 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3c83b0af-ee7e-468d-a5d7-34acfa96812b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:34.463835 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3c83b0af-ee7e-468d-a5d7-34acfa96812b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:34.464779 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3c83b0af-ee7e-468d-a5d7-34acfa96812b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:34.465291 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3c83b0af-ee7e-468d-a5d7-34acfa96812b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:34.500866 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-3c83b0af-ee7e-468d-a5d7-34acfa96812b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053834 Feb 09 13:13:34.501740 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 187/359] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:13:34 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:13:35.452841 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-f4397f32-09a1-41e1-a265-5e87fdf00a1e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:35.454243 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-f4397f32-09a1-41e1-a265-5e87fdf00a1e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:35.464766 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f4397f32-09a1-41e1-a265-5e87fdf00a1e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:35.465833 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f4397f32-09a1-41e1-a265-5e87fdf00a1e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:35.468721 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f4397f32-09a1-41e1-a265-5e87fdf00a1e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:35.469233 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f4397f32-09a1-41e1-a265-5e87fdf00a1e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:35.512895 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-72fcd559-fcea-4a4e-bd59-d7dfbc762756 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:35.513330 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-72fcd559-fcea-4a4e-bd59-d7dfbc762756 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:35.520924 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-72fcd559-fcea-4a4e-bd59-d7dfbc762756 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:35.521369 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-72fcd559-fcea-4a4e-bd59-d7dfbc762756 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:35.522150 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-72fcd559-fcea-4a4e-bd59-d7dfbc762756 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:35.523365 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-72fcd559-fcea-4a4e-bd59-d7dfbc762756 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:35.564361 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-72fcd559-fcea-4a4e-bd59-d7dfbc762756 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055626 Feb 09 13:13:35.565556 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 188/360] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:13:35 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:13:35.643684 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-f4397f32-09a1-41e1-a265-5e87fdf00a1e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:35.652489 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-f4397f32-09a1-41e1-a265-5e87fdf00a1e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1514 microversion: 2.1 time: 0.203638 Feb 09 13:13:35.653826 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 173/361] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:35 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:35.670394 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-b8517fa4-2e99-447e-b448-f9d88c2edb3e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "facb3b3e-fda6-4c94-96d6-e2b44bb5793f"}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:13:35.671522 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-b8517fa4-2e99-447e-b448-f9d88c2edb3e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:35.681535 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b8517fa4-2e99-447e-b448-f9d88c2edb3e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:35.681996 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b8517fa4-2e99-447e-b448-f9d88c2edb3e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:35.682835 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b8517fa4-2e99-447e-b448-f9d88c2edb3e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:35.685006 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b8517fa4-2e99-447e-b448-f9d88c2edb3e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:36.576442 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8e3be341-303f-4245-9c41-a92b1f20d49f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:36.577383 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8e3be341-303f-4245-9c41-a92b1f20d49f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:36.586198 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8e3be341-303f-4245-9c41-a92b1f20d49f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:36.586673 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8e3be341-303f-4245-9c41-a92b1f20d49f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:36.587673 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8e3be341-303f-4245-9c41-a92b1f20d49f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:36.588376 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8e3be341-303f-4245-9c41-a92b1f20d49f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:36.640412 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8e3be341-303f-4245-9c41-a92b1f20d49f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068181 Feb 09 13:13:36.641612 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 174/362] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:13:36 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:13:37.655859 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-5aa727cf-5229-4f52-9b3e-9ab8a036d9f1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:37.663180 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-5aa727cf-5229-4f52-9b3e-9ab8a036d9f1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:37.664808 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5aa727cf-5229-4f52-9b3e-9ab8a036d9f1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:37.665416 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5aa727cf-5229-4f52-9b3e-9ab8a036d9f1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:37.666251 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5aa727cf-5229-4f52-9b3e-9ab8a036d9f1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:37.666747 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5aa727cf-5229-4f52-9b3e-9ab8a036d9f1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:37.701640 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-5aa727cf-5229-4f52-9b3e-9ab8a036d9f1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052010 Feb 09 13:13:37.702431 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 175/363] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:13:37 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:13:38.535188 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-b8517fa4-2e99-447e-b448-f9d88c2edb3e tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "POST /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.868542 Feb 09 13:13:38.535946 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 189/364] 10.222.0.84 () {60 vars in 1322 bytes} [Wed Feb 9 13:13:35 2022] POST /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/os-volume_attachments => generated 194 bytes in 2870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:13:38.715240 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-32c53f06-0b1a-40b0-b413-4946fe1fc116 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:38.716353 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-32c53f06-0b1a-40b0-b413-4946fe1fc116 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:38.735096 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-32c53f06-0b1a-40b0-b413-4946fe1fc116 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:38.735560 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-32c53f06-0b1a-40b0-b413-4946fe1fc116 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:38.736411 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-32c53f06-0b1a-40b0-b413-4946fe1fc116 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:38.736871 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-32c53f06-0b1a-40b0-b413-4946fe1fc116 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:38.777147 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-32c53f06-0b1a-40b0-b413-4946fe1fc116 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067093 Feb 09 13:13:38.777723 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 176/365] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:13:38 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:13:39.269228 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-82add8be-c063-4c5c-9b2b-e729949ddc5b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Action: 'create', calling method: .version_select at 0x7f7f648e5dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-904893309"}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:13:39.284002 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-82add8be-c063-4c5c-9b2b-e729949ddc5b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Getting quotas for project ac777728da844e3a91e4d65d4aa9e4a5. Resources: {'key_pairs'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:13:39.288175 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-82add8be-c063-4c5c-9b2b-e729949ddc5b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Getting quotas for user d1964ee70c93404fbaec3cf03672d364 and project ac777728da844e3a91e4d65d4aa9e4a5. Resources: {'key_pairs'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:13:39.670533 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-82add8be-c063-4c5c-9b2b-e729949ddc5b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Getting quotas for project ac777728da844e3a91e4d65d4aa9e4a5. Resources: {'key_pairs'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:13:39.674200 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-82add8be-c063-4c5c-9b2b-e729949ddc5b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Getting quotas for user d1964ee70c93404fbaec3cf03672d364 and project ac777728da844e3a91e4d65d4aa9e4a5. Resources: {'key_pairs'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:13:39.687371 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-82add8be-c063-4c5c-9b2b-e729949ddc5b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.423120 Feb 09 13:13:39.688091 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 190/366] 10.222.0.84 () {60 vars in 1157 bytes} [Wed Feb 9 13:13:39 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:39.795745 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-65ec0038-c152-4b07-8786-9474cee9dec2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:39.797585 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-65ec0038-c152-4b07-8786-9474cee9dec2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:39.803127 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-65ec0038-c152-4b07-8786-9474cee9dec2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:39.803768 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-65ec0038-c152-4b07-8786-9474cee9dec2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:39.804755 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-65ec0038-c152-4b07-8786-9474cee9dec2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:39.805193 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-65ec0038-c152-4b07-8786-9474cee9dec2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:39.808285 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-c4e687b8-cd4b-4545-b1d1-ebe468f8e958 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-136261622", "imageRef": "7a2e2abc-5394-4eda-8f68-fa08892f63c5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-904893309", "networks": [{"uuid": "2d8539eb-78a6-4037-811a-eb4032e8827a"}]}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:13:39.836327 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-65ec0038-c152-4b07-8786-9474cee9dec2 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044210 Feb 09 13:13:39.836900 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 177/367] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:13:39 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:13:39.865584 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-406ec1fa-3b29-4e65-8eee-31805776b018 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:13:39.865769 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-406ec1fa-3b29-4e65-8eee-31805776b018 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:39.866229 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-406ec1fa-3b29-4e65-8eee-31805776b018 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:39.869805 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.network.neutron [None req-c4e687b8-cd4b-4545-b1d1-ebe468f8e958 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] validate_networks() for [('2d8539eb-78a6-4037-811a-eb4032e8827a', None, None, None, None, None)] {{(pid=116748) validate_networks /opt/stack/nova/nova/network/neutron.py:2554}} Feb 09 13:13:39.942264 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-406ec1fa-3b29-4e65-8eee-31805776b018 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Going to try to stop instance {{(pid=116749) force_stop /opt/stack/nova/nova/compute/api.py:2655}} Feb 09 13:13:40.159151 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-406ec1fa-3b29-4e65-8eee-31805776b018 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "POST /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991/action" status: 202 len: 0 microversion: 2.1 time: 0.303278 Feb 09 13:13:40.163773 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 178/368] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Feb 9 13:13:39 2022] POST /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 09 13:13:40.168943 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c8ee8233-a76b-4cd6-b16c-5d44a785b311 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:40.170076 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-c8ee8233-a76b-4cd6-b16c-5d44a785b311 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:40.177416 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c8ee8233-a76b-4cd6-b16c-5d44a785b311 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:40.178076 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c8ee8233-a76b-4cd6-b16c-5d44a785b311 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:40.179066 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c8ee8233-a76b-4cd6-b16c-5d44a785b311 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:40.179492 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c8ee8233-a76b-4cd6-b16c-5d44a785b311 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:40.341125 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-c4e687b8-cd4b-4545-b1d1-ebe468f8e958 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Flavor limits 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 09 13:13:40.341546 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-c4e687b8-cd4b-4545-b1d1-ebe468f8e958 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Image limits 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 09 13:13:40.342215 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-c4e687b8-cd4b-4545-b1d1-ebe468f8e958 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Flavor pref 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 09 13:13:40.342840 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-c4e687b8-cd4b-4545-b1d1-ebe468f8e958 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Image pref 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 09 13:13:40.343404 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-c4e687b8-cd4b-4545-b1d1-ebe468f8e958 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 09 13:13:40.352811 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c4e687b8-cd4b-4545-b1d1-ebe468f8e958 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:40.364595 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c4e687b8-cd4b-4545-b1d1-ebe468f8e958 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:40.365868 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c4e687b8-cd4b-4545-b1d1-ebe468f8e958 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:40.370840 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c4e687b8-cd4b-4545-b1d1-ebe468f8e958 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:40.394654 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-c4e687b8-cd4b-4545-b1d1-ebe468f8e958 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Getting quotas for project ac777728da844e3a91e4d65d4aa9e4a5. Resources: {'instances', 'cores', 'ram'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:13:40.400042 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-c4e687b8-cd4b-4545-b1d1-ebe468f8e958 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Getting quotas for user d1964ee70c93404fbaec3cf03672d364 and project ac777728da844e3a91e4d65d4aa9e4a5. Resources: {'instances', 'cores', 'ram'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:13:40.412241 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-c4e687b8-cd4b-4545-b1d1-ebe468f8e958 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Going to run 1 instances... {{(pid=116748) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 09 13:13:40.414978 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-c4e687b8-cd4b-4545-b1d1-ebe468f8e958 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7a2e2abc-5394-4eda-8f68-fa08892f63c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 09 13:13:40.415504 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c8ee8233-a76b-4cd6-b16c-5d44a785b311 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:40.425463 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c8ee8233-a76b-4cd6-b16c-5d44a785b311 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1725 microversion: 2.1 time: 0.260287 Feb 09 13:13:40.426753 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 179/369] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:40 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1725 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:40.571385 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-c4e687b8-cd4b-4545-b1d1-ebe468f8e958 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767420 Feb 09 13:13:40.572356 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 191/370] 10.222.0.84 () {60 vars in 1146 bytes} [Wed Feb 9 13:13:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 09 13:13:40.584355 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-10265515-4516-4312-89df-e21d00f873c9 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:40.585035 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-10265515-4516-4312-89df-e21d00f873c9 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:40.674205 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-10265515-4516-4312-89df-e21d00f873c9 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:40.675222 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-10265515-4516-4312-89df-e21d00f873c9 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1257 microversion: 2.1 time: 0.095244 Feb 09 13:13:40.675761 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 180/371] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:40 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1257 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:40.848354 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-164ec4be-477f-420f-9a89-f3cffff75c43 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:40.849320 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-164ec4be-477f-420f-9a89-f3cffff75c43 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:40.856252 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-164ec4be-477f-420f-9a89-f3cffff75c43 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:40.866720 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-164ec4be-477f-420f-9a89-f3cffff75c43 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:40.866720 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-164ec4be-477f-420f-9a89-f3cffff75c43 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:40.866720 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-164ec4be-477f-420f-9a89-f3cffff75c43 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:40.888976 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-164ec4be-477f-420f-9a89-f3cffff75c43 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044558 Feb 09 13:13:40.890179 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 192/372] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:13:40 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 09 13:13:41.043014 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-41f275f1-defb-41ad-8f22-c49d58f2ad67 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1801383500", "imageRef": "af86cedd-e7d5-4a28-a810-f47830f4bffc", "flavorRef": "452", "networks": [{"uuid": "ff34e378-f58b-45e9-a487-b72107a8e88d"}]}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:13:41.098269 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.network.neutron [None req-41f275f1-defb-41ad-8f22-c49d58f2ad67 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] validate_networks() for [('ff34e378-f58b-45e9-a487-b72107a8e88d', None, None, None, None, None)] {{(pid=116749) validate_networks /opt/stack/nova/nova/network/neutron.py:2554}} Feb 09 13:13:41.443565 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-b866c55f-2497-433c-9137-369a54c11912 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:41.444284 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-b866c55f-2497-433c-9137-369a54c11912 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:41.451746 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b866c55f-2497-433c-9137-369a54c11912 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:41.452891 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b866c55f-2497-433c-9137-369a54c11912 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:41.454740 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b866c55f-2497-433c-9137-369a54c11912 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:41.455911 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b866c55f-2497-433c-9137-369a54c11912 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:41.472266 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-41f275f1-defb-41ad-8f22-c49d58f2ad67 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Flavor limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 09 13:13:41.473497 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-41f275f1-defb-41ad-8f22-c49d58f2ad67 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Image limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 09 13:13:41.474099 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-41f275f1-defb-41ad-8f22-c49d58f2ad67 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Flavor pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 09 13:13:41.474739 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-41f275f1-defb-41ad-8f22-c49d58f2ad67 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Image pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 09 13:13:41.475361 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-41f275f1-defb-41ad-8f22-c49d58f2ad67 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 09 13:13:41.485960 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-41f275f1-defb-41ad-8f22-c49d58f2ad67 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:41.486521 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-41f275f1-defb-41ad-8f22-c49d58f2ad67 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:41.487475 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-41f275f1-defb-41ad-8f22-c49d58f2ad67 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:41.488061 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-41f275f1-defb-41ad-8f22-c49d58f2ad67 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:41.510110 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-41f275f1-defb-41ad-8f22-c49d58f2ad67 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Getting quotas for project a0e498b288c5455ea4e270d16d92dc89. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:13:41.514769 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-41f275f1-defb-41ad-8f22-c49d58f2ad67 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Getting quotas for user 39ee736e50d340be8da8586ee48fc7b5 and project a0e498b288c5455ea4e270d16d92dc89. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:13:41.534332 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-41f275f1-defb-41ad-8f22-c49d58f2ad67 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Going to run 1 instances... {{(pid=116749) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 09 13:13:41.537024 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-41f275f1-defb-41ad-8f22-c49d58f2ad67 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af86cedd-e7d5-4a28-a810-f47830f4bffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 09 13:13:41.612852 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-b866c55f-2497-433c-9137-369a54c11912 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:41.621395 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-b866c55f-2497-433c-9137-369a54c11912 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1725 microversion: 2.1 time: 0.181356 Feb 09 13:13:41.622315 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 193/373] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:41 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:13:41.701148 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-0ca74a2b-81fc-491d-a9f5-1b575c3e169f tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:41.701148 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-0ca74a2b-81fc-491d-a9f5-1b575c3e169f tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:41.726754 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-41f275f1-defb-41ad-8f22-c49d58f2ad67 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687454 Feb 09 13:13:41.727662 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 181/374] 10.222.0.84 () {60 vars in 1146 bytes} [Wed Feb 9 13:13:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 09 13:13:41.738847 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-fa6eafa3-a299-49ae-a769-231bbe6d8160 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:41.740168 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-fa6eafa3-a299-49ae-a769-231bbe6d8160 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:41.757634 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-0ca74a2b-81fc-491d-a9f5-1b575c3e169f tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:41.768900 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-0ca74a2b-81fc-491d-a9f5-1b575c3e169f tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1257 microversion: 2.1 time: 0.080308 Feb 09 13:13:41.769475 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 194/375] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:41 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1257 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:13:41.815147 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-fa6eafa3-a299-49ae-a769-231bbe6d8160 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:41.826641 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-fa6eafa3-a299-49ae-a769-231bbe6d8160 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1218 microversion: 2.1 time: 0.092624 Feb 09 13:13:41.828100 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 182/376] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:41 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:42.648926 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-fde225a8-8dbf-47b5-98cb-5e69d80a54f4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:42.650666 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-fde225a8-8dbf-47b5-98cb-5e69d80a54f4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:42.658180 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fde225a8-8dbf-47b5-98cb-5e69d80a54f4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:42.658672 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fde225a8-8dbf-47b5-98cb-5e69d80a54f4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:42.659461 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fde225a8-8dbf-47b5-98cb-5e69d80a54f4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:42.659900 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fde225a8-8dbf-47b5-98cb-5e69d80a54f4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:42.785301 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-e7cbd680-907f-4690-bfe1-00603f77c773 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:42.785991 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-e7cbd680-907f-4690-bfe1-00603f77c773 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:42.792838 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e7cbd680-907f-4690-bfe1-00603f77c773 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:42.793467 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e7cbd680-907f-4690-bfe1-00603f77c773 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:42.794290 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e7cbd680-907f-4690-bfe1-00603f77c773 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:42.794761 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e7cbd680-907f-4690-bfe1-00603f77c773 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:42.804939 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-fde225a8-8dbf-47b5-98cb-5e69d80a54f4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:42.813499 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-fde225a8-8dbf-47b5-98cb-5e69d80a54f4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1725 microversion: 2.1 time: 0.168630 Feb 09 13:13:42.821968 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 195/377] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:42 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:42.849356 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-2d91a284-22f8-46c3-abb9-4d5720cb92cf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:42.849973 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-2d91a284-22f8-46c3-abb9-4d5720cb92cf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:42.856432 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2d91a284-22f8-46c3-abb9-4d5720cb92cf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:42.856888 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2d91a284-22f8-46c3-abb9-4d5720cb92cf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:42.857681 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2d91a284-22f8-46c3-abb9-4d5720cb92cf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:42.858120 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2d91a284-22f8-46c3-abb9-4d5720cb92cf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:42.871773 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-e7cbd680-907f-4690-bfe1-00603f77c773 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:42.880389 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-e7cbd680-907f-4690-bfe1-00603f77c773 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1309 microversion: 2.1 time: 0.098972 Feb 09 13:13:42.890802 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 183/378] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:42 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:13:42.925234 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-2d91a284-22f8-46c3-abb9-4d5720cb92cf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:42.940417 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-2d91a284-22f8-46c3-abb9-4d5720cb92cf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1222 microversion: 2.1 time: 0.094623 Feb 09 13:13:42.942719 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 196/379] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:42 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:43.830730 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-3258bb39-5adc-4603-9597-37be04057ff4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:43.832691 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-3258bb39-5adc-4603-9597-37be04057ff4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:43.843545 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3258bb39-5adc-4603-9597-37be04057ff4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:43.844073 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3258bb39-5adc-4603-9597-37be04057ff4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:43.844946 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3258bb39-5adc-4603-9597-37be04057ff4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:43.845459 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3258bb39-5adc-4603-9597-37be04057ff4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:43.899598 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-7ba9aabf-936b-45f0-bcb0-2bc7ec217e9b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:43.900846 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-7ba9aabf-936b-45f0-bcb0-2bc7ec217e9b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:43.910638 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7ba9aabf-936b-45f0-bcb0-2bc7ec217e9b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:43.911396 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7ba9aabf-936b-45f0-bcb0-2bc7ec217e9b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:43.912358 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7ba9aabf-936b-45f0-bcb0-2bc7ec217e9b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:43.912940 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7ba9aabf-936b-45f0-bcb0-2bc7ec217e9b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:44.076023 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-7ba9aabf-936b-45f0-bcb0-2bc7ec217e9b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:44.095627 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-7ba9aabf-936b-45f0-bcb0-2bc7ec217e9b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1315 microversion: 2.1 time: 0.201018 Feb 09 13:13:44.096388 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 197/380] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:43 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:13:44.106458 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-2d097e9f-394d-4463-a582-969ac2f5a710 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:44.107399 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-2d097e9f-394d-4463-a582-969ac2f5a710 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:44.122537 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2d097e9f-394d-4463-a582-969ac2f5a710 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:44.123279 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2d097e9f-394d-4463-a582-969ac2f5a710 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:44.125582 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2d097e9f-394d-4463-a582-969ac2f5a710 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:44.126909 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2d097e9f-394d-4463-a582-969ac2f5a710 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:44.182793 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3258bb39-5adc-4603-9597-37be04057ff4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:44.194914 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-3258bb39-5adc-4603-9597-37be04057ff4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1725 microversion: 2.1 time: 0.367804 Feb 09 13:13:44.205563 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 184/381] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:43 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1725 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:44.219537 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-2d097e9f-394d-4463-a582-969ac2f5a710 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:44.233786 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-2d097e9f-394d-4463-a582-969ac2f5a710 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1270 microversion: 2.1 time: 0.130203 Feb 09 13:13:44.233786 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 198/382] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:44 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1270 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:45.138403 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-6d5c5ab1-c941-4af9-9037-e3e529490b37 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:45.140553 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-6d5c5ab1-c941-4af9-9037-e3e529490b37 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:45.152856 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6d5c5ab1-c941-4af9-9037-e3e529490b37 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:45.153650 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6d5c5ab1-c941-4af9-9037-e3e529490b37 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:45.154864 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6d5c5ab1-c941-4af9-9037-e3e529490b37 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:45.155610 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6d5c5ab1-c941-4af9-9037-e3e529490b37 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:45.218468 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-eefe00f6-97ee-4451-96d4-85c6576e3703 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:45.219201 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-eefe00f6-97ee-4451-96d4-85c6576e3703 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:45.232184 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-eefe00f6-97ee-4451-96d4-85c6576e3703 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:45.236422 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-eefe00f6-97ee-4451-96d4-85c6576e3703 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:45.243234 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-eefe00f6-97ee-4451-96d4-85c6576e3703 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:45.251053 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-eefe00f6-97ee-4451-96d4-85c6576e3703 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:45.476603 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6d5c5ab1-c941-4af9-9037-e3e529490b37 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:45.490678 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-6d5c5ab1-c941-4af9-9037-e3e529490b37 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.378120 Feb 09 13:13:45.491884 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 185/383] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:45 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:45.497457 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-87feaa38-7f8d-44c1-b211-d256b584bb3e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:45.498503 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-87feaa38-7f8d-44c1-b211-d256b584bb3e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:45.507031 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-87feaa38-7f8d-44c1-b211-d256b584bb3e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:45.508051 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-87feaa38-7f8d-44c1-b211-d256b584bb3e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:45.509952 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-87feaa38-7f8d-44c1-b211-d256b584bb3e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:45.510771 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-87feaa38-7f8d-44c1-b211-d256b584bb3e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:45.591710 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-87feaa38-7f8d-44c1-b211-d256b584bb3e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:45.600765 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-eefe00f6-97ee-4451-96d4-85c6576e3703 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:45.610018 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-eefe00f6-97ee-4451-96d4-85c6576e3703 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1725 microversion: 2.1 time: 0.401078 Feb 09 13:13:45.611464 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 199/384] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:45 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1725 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:45.613924 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-87feaa38-7f8d-44c1-b211-d256b584bb3e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1288 microversion: 2.1 time: 0.120717 Feb 09 13:13:45.623243 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 186/385] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:45 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1288 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:46.510841 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-b843fd1e-a2da-4ecd-be7a-2d60ddd7b9e2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:46.511631 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-b843fd1e-a2da-4ecd-be7a-2d60ddd7b9e2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:46.524598 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b843fd1e-a2da-4ecd-be7a-2d60ddd7b9e2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:46.535109 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b843fd1e-a2da-4ecd-be7a-2d60ddd7b9e2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:46.536098 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b843fd1e-a2da-4ecd-be7a-2d60ddd7b9e2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:46.538011 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b843fd1e-a2da-4ecd-be7a-2d60ddd7b9e2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:46.628201 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8cf3dd3e-2dc1-48ba-aced-d3aaf4bb6a45 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:46.628812 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8cf3dd3e-2dc1-48ba-aced-d3aaf4bb6a45 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:46.635757 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8cf3dd3e-2dc1-48ba-aced-d3aaf4bb6a45 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:46.636216 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8cf3dd3e-2dc1-48ba-aced-d3aaf4bb6a45 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:46.637019 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8cf3dd3e-2dc1-48ba-aced-d3aaf4bb6a45 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:46.637467 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8cf3dd3e-2dc1-48ba-aced-d3aaf4bb6a45 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:46.720515 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-b843fd1e-a2da-4ecd-be7a-2d60ddd7b9e2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:46.733976 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-b843fd1e-a2da-4ecd-be7a-2d60ddd7b9e2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.229984 Feb 09 13:13:46.736908 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 200/386] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:46 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:46.741596 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d2ffe81c-0da2-48b1-9dde-feb4eb87ad8f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:46.742403 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d2ffe81c-0da2-48b1-9dde-feb4eb87ad8f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:46.749620 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d2ffe81c-0da2-48b1-9dde-feb4eb87ad8f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:46.750164 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d2ffe81c-0da2-48b1-9dde-feb4eb87ad8f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:46.751235 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d2ffe81c-0da2-48b1-9dde-feb4eb87ad8f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:46.751884 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d2ffe81c-0da2-48b1-9dde-feb4eb87ad8f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:46.850868 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8cf3dd3e-2dc1-48ba-aced-d3aaf4bb6a45 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:46.860902 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8cf3dd3e-2dc1-48ba-aced-d3aaf4bb6a45 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1725 microversion: 2.1 time: 0.236642 Feb 09 13:13:46.862645 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 187/387] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:46 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1725 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:13:47.000072 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d2ffe81c-0da2-48b1-9dde-feb4eb87ad8f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:47.026011 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d2ffe81c-0da2-48b1-9dde-feb4eb87ad8f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1330 microversion: 2.1 time: 0.287740 Feb 09 13:13:47.026622 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 201/388] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:46 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1330 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:47.752097 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-a43ae0f6-74e3-4c73-8d5b-35bd349dbc7b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:47.752845 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-a43ae0f6-74e3-4c73-8d5b-35bd349dbc7b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:47.760333 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a43ae0f6-74e3-4c73-8d5b-35bd349dbc7b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:47.760809 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a43ae0f6-74e3-4c73-8d5b-35bd349dbc7b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:47.761611 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a43ae0f6-74e3-4c73-8d5b-35bd349dbc7b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:47.762050 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a43ae0f6-74e3-4c73-8d5b-35bd349dbc7b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:47.884455 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-da5b2ca6-f057-41ed-b15e-7f4fdb2edfaa tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:47.885181 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-da5b2ca6-f057-41ed-b15e-7f4fdb2edfaa tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:47.892324 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-da5b2ca6-f057-41ed-b15e-7f4fdb2edfaa tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:47.892780 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-da5b2ca6-f057-41ed-b15e-7f4fdb2edfaa tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:47.893766 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-da5b2ca6-f057-41ed-b15e-7f4fdb2edfaa tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:47.894213 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-da5b2ca6-f057-41ed-b15e-7f4fdb2edfaa tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:47.940917 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-a43ae0f6-74e3-4c73-8d5b-35bd349dbc7b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:47.949387 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-a43ae0f6-74e3-4c73-8d5b-35bd349dbc7b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.201574 Feb 09 13:13:47.950920 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 188/389] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:47 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:48.043314 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ea8bde7e-83cb-45b7-a4c3-b4cf2dfdd6ab tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:48.043917 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-ea8bde7e-83cb-45b7-a4c3-b4cf2dfdd6ab tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:48.062689 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ea8bde7e-83cb-45b7-a4c3-b4cf2dfdd6ab tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:48.064254 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ea8bde7e-83cb-45b7-a4c3-b4cf2dfdd6ab tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:48.065052 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ea8bde7e-83cb-45b7-a4c3-b4cf2dfdd6ab tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:48.066170 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ea8bde7e-83cb-45b7-a4c3-b4cf2dfdd6ab tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:48.144561 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-da5b2ca6-f057-41ed-b15e-7f4fdb2edfaa tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:48.153613 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-da5b2ca6-f057-41ed-b15e-7f4fdb2edfaa tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1725 microversion: 2.1 time: 0.274001 Feb 09 13:13:48.155500 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 202/390] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:47 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1725 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:13:48.249334 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ea8bde7e-83cb-45b7-a4c3-b4cf2dfdd6ab tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:48.257626 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-ea8bde7e-83cb-45b7-a4c3-b4cf2dfdd6ab tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1330 microversion: 2.1 time: 0.218532 Feb 09 13:13:48.267784 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 189/391] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:48 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1330 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:13:48.966534 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-8eeca602-9da3-485f-8271-55d8e3b81763 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:48.967279 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-8eeca602-9da3-485f-8271-55d8e3b81763 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:48.973409 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8eeca602-9da3-485f-8271-55d8e3b81763 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:48.978404 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8eeca602-9da3-485f-8271-55d8e3b81763 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:48.978404 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8eeca602-9da3-485f-8271-55d8e3b81763 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:48.978404 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8eeca602-9da3-485f-8271-55d8e3b81763 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:49.124680 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-8eeca602-9da3-485f-8271-55d8e3b81763 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:49.133157 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-8eeca602-9da3-485f-8271-55d8e3b81763 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.170607 Feb 09 13:13:49.143025 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 203/392] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:48 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:49.171683 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-57eef9c3-915a-420b-8f27-f9edc539b8b8 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:49.172306 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-57eef9c3-915a-420b-8f27-f9edc539b8b8 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:49.178680 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-57eef9c3-915a-420b-8f27-f9edc539b8b8 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:49.179137 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-57eef9c3-915a-420b-8f27-f9edc539b8b8 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:49.179924 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-57eef9c3-915a-420b-8f27-f9edc539b8b8 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:49.180365 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-57eef9c3-915a-420b-8f27-f9edc539b8b8 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:49.278998 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-32f94e11-3e6b-4d19-a93d-8495aaf58907 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:49.280009 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-32f94e11-3e6b-4d19-a93d-8495aaf58907 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:49.287888 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-32f94e11-3e6b-4d19-a93d-8495aaf58907 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:49.288891 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-32f94e11-3e6b-4d19-a93d-8495aaf58907 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:49.290942 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-32f94e11-3e6b-4d19-a93d-8495aaf58907 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:49.291719 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-32f94e11-3e6b-4d19-a93d-8495aaf58907 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:49.365750 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-57eef9c3-915a-420b-8f27-f9edc539b8b8 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:49.380651 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-57eef9c3-915a-420b-8f27-f9edc539b8b8 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1725 microversion: 2.1 time: 0.212483 Feb 09 13:13:49.381352 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 190/393] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:49 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:13:49.461886 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-32f94e11-3e6b-4d19-a93d-8495aaf58907 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:49.469453 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-32f94e11-3e6b-4d19-a93d-8495aaf58907 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1330 microversion: 2.1 time: 0.197395 Feb 09 13:13:49.470024 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 204/394] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:49 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1330 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:50.151092 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-4cc2722d-efe5-4158-aaf6-f1ffa4b0fd7a tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:50.151712 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-4cc2722d-efe5-4158-aaf6-f1ffa4b0fd7a tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:50.157754 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4cc2722d-efe5-4158-aaf6-f1ffa4b0fd7a tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:50.158210 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4cc2722d-efe5-4158-aaf6-f1ffa4b0fd7a tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:50.159024 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4cc2722d-efe5-4158-aaf6-f1ffa4b0fd7a tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:50.159479 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4cc2722d-efe5-4158-aaf6-f1ffa4b0fd7a tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:50.315482 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-4cc2722d-efe5-4158-aaf6-f1ffa4b0fd7a tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:50.323829 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-4cc2722d-efe5-4158-aaf6-f1ffa4b0fd7a tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.176987 Feb 09 13:13:50.324607 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 191/395] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:50 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:13:50.398475 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-dd17c168-51d1-488a-bba6-086610c1dc2f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:50.399254 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-dd17c168-51d1-488a-bba6-086610c1dc2f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:50.405693 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-dd17c168-51d1-488a-bba6-086610c1dc2f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:50.406146 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-dd17c168-51d1-488a-bba6-086610c1dc2f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:50.406950 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-dd17c168-51d1-488a-bba6-086610c1dc2f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:50.407386 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-dd17c168-51d1-488a-bba6-086610c1dc2f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:50.491681 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-166ca90e-7d04-48b8-8000-73e93e5e1377 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:50.492511 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-166ca90e-7d04-48b8-8000-73e93e5e1377 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:50.499279 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-166ca90e-7d04-48b8-8000-73e93e5e1377 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:50.500011 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-166ca90e-7d04-48b8-8000-73e93e5e1377 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:50.501005 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-166ca90e-7d04-48b8-8000-73e93e5e1377 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:50.501636 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-166ca90e-7d04-48b8-8000-73e93e5e1377 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:50.569665 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-dd17c168-51d1-488a-bba6-086610c1dc2f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:50.572473 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-dd17c168-51d1-488a-bba6-086610c1dc2f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1725 microversion: 2.1 time: 0.177791 Feb 09 13:13:50.573239 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 205/396] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:50 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:50.650281 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-166ca90e-7d04-48b8-8000-73e93e5e1377 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:50.657526 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-166ca90e-7d04-48b8-8000-73e93e5e1377 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1330 microversion: 2.1 time: 0.175660 Feb 09 13:13:50.658091 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 192/397] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:50 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1330 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:13:51.341534 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-4caa8834-92f8-49af-a48e-67a7c883f096 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:51.342139 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-4caa8834-92f8-49af-a48e-67a7c883f096 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:51.348892 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4caa8834-92f8-49af-a48e-67a7c883f096 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:51.349350 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4caa8834-92f8-49af-a48e-67a7c883f096 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:51.350208 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4caa8834-92f8-49af-a48e-67a7c883f096 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:51.350682 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4caa8834-92f8-49af-a48e-67a7c883f096 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:51.541798 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-4caa8834-92f8-49af-a48e-67a7c883f096 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:51.554206 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-4caa8834-92f8-49af-a48e-67a7c883f096 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.217440 Feb 09 13:13:51.554900 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 206/398] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:51 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:51.589261 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c8ccf35f-926b-4363-bbdb-b3c10f91db62 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:51.590279 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-c8ccf35f-926b-4363-bbdb-b3c10f91db62 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:51.596594 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c8ccf35f-926b-4363-bbdb-b3c10f91db62 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:51.601718 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c8ccf35f-926b-4363-bbdb-b3c10f91db62 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:51.601718 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c8ccf35f-926b-4363-bbdb-b3c10f91db62 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:51.601718 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c8ccf35f-926b-4363-bbdb-b3c10f91db62 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:51.674516 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-fb927474-bf15-4c2d-9d61-81f5c444e478 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:51.675583 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-fb927474-bf15-4c2d-9d61-81f5c444e478 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:51.683467 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fb927474-bf15-4c2d-9d61-81f5c444e478 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:51.684187 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fb927474-bf15-4c2d-9d61-81f5c444e478 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:51.685417 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fb927474-bf15-4c2d-9d61-81f5c444e478 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:51.686073 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fb927474-bf15-4c2d-9d61-81f5c444e478 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:51.823071 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c8ccf35f-926b-4363-bbdb-b3c10f91db62 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:51.823071 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c8ccf35f-926b-4363-bbdb-b3c10f91db62 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1725 microversion: 2.1 time: 0.208109 Feb 09 13:13:51.823071 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 193/399] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:51 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:13:51.851020 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-fb927474-bf15-4c2d-9d61-81f5c444e478 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:51.859209 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-fb927474-bf15-4c2d-9d61-81f5c444e478 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1330 microversion: 2.1 time: 0.188206 Feb 09 13:13:51.861570 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 207/400] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:51 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1330 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:13:52.576462 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c24967bf-8f25-4c1e-8920-2943ae866ac0 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:52.576462 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-c24967bf-8f25-4c1e-8920-2943ae866ac0 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:52.581519 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c24967bf-8f25-4c1e-8920-2943ae866ac0 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:52.582261 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c24967bf-8f25-4c1e-8920-2943ae866ac0 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:52.588010 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c24967bf-8f25-4c1e-8920-2943ae866ac0 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:52.588010 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c24967bf-8f25-4c1e-8920-2943ae866ac0 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:52.749549 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c24967bf-8f25-4c1e-8920-2943ae866ac0 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:52.756984 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c24967bf-8f25-4c1e-8920-2943ae866ac0 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.188756 Feb 09 13:13:52.757558 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 194/401] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:52 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:13:52.811068 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-ba978870-a1f0-43b3-9c46-4e04fbf807da tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:52.811680 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-ba978870-a1f0-43b3-9c46-4e04fbf807da tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:52.817937 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ba978870-a1f0-43b3-9c46-4e04fbf807da tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:52.823103 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ba978870-a1f0-43b3-9c46-4e04fbf807da tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:52.823103 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ba978870-a1f0-43b3-9c46-4e04fbf807da tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:52.823103 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ba978870-a1f0-43b3-9c46-4e04fbf807da tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:52.881266 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c103e033-8d3c-4c0d-a54c-375d5eb72f9d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:52.882522 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-c103e033-8d3c-4c0d-a54c-375d5eb72f9d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:52.893560 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c103e033-8d3c-4c0d-a54c-375d5eb72f9d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:52.898121 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c103e033-8d3c-4c0d-a54c-375d5eb72f9d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:52.898121 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c103e033-8d3c-4c0d-a54c-375d5eb72f9d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:52.898121 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c103e033-8d3c-4c0d-a54c-375d5eb72f9d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:52.999184 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ba978870-a1f0-43b3-9c46-4e04fbf807da tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:53.007334 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-ba978870-a1f0-43b3-9c46-4e04fbf807da tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1725 microversion: 2.1 time: 0.199918 Feb 09 13:13:53.017114 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 208/402] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:52 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:53.058939 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c103e033-8d3c-4c0d-a54c-375d5eb72f9d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:53.085317 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c103e033-8d3c-4c0d-a54c-375d5eb72f9d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1330 microversion: 2.1 time: 0.206728 Feb 09 13:13:53.085317 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 195/403] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:52 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1330 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:53.774763 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-5635e5e7-2f83-4e56-977c-3695869525ae tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:53.775401 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-5635e5e7-2f83-4e56-977c-3695869525ae tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:53.781419 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5635e5e7-2f83-4e56-977c-3695869525ae tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:53.781875 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5635e5e7-2f83-4e56-977c-3695869525ae tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:53.782779 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5635e5e7-2f83-4e56-977c-3695869525ae tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:53.783222 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5635e5e7-2f83-4e56-977c-3695869525ae tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:53.923522 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-5635e5e7-2f83-4e56-977c-3695869525ae tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:53.934348 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-5635e5e7-2f83-4e56-977c-3695869525ae tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.163616 Feb 09 13:13:53.938422 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 209/404] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:53 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:54.024914 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-bf14d279-65fb-4142-9588-bbcab2e5be57 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:54.025515 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-bf14d279-65fb-4142-9588-bbcab2e5be57 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:54.031843 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bf14d279-65fb-4142-9588-bbcab2e5be57 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:54.032300 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bf14d279-65fb-4142-9588-bbcab2e5be57 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:54.033088 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bf14d279-65fb-4142-9588-bbcab2e5be57 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:54.033528 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bf14d279-65fb-4142-9588-bbcab2e5be57 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:54.101401 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-b24c56ef-989d-44ae-8025-107b0840b109 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:54.101869 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-b24c56ef-989d-44ae-8025-107b0840b109 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:54.109513 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b24c56ef-989d-44ae-8025-107b0840b109 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:54.109960 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b24c56ef-989d-44ae-8025-107b0840b109 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:54.111013 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b24c56ef-989d-44ae-8025-107b0840b109 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:54.111450 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b24c56ef-989d-44ae-8025-107b0840b109 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:54.201976 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-bf14d279-65fb-4142-9588-bbcab2e5be57 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:54.216707 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-bf14d279-65fb-4142-9588-bbcab2e5be57 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1725 microversion: 2.1 time: 0.195631 Feb 09 13:13:54.217515 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 196/405] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:54 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:54.323368 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-b24c56ef-989d-44ae-8025-107b0840b109 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:54.331052 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-b24c56ef-989d-44ae-8025-107b0840b109 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1330 microversion: 2.1 time: 0.233424 Feb 09 13:13:54.331906 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 210/406] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:54 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1330 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:13:54.953123 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-b2db98ec-f769-4cfd-90d8-667479d6efef tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:54.954844 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-b2db98ec-f769-4cfd-90d8-667479d6efef tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:54.967782 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b2db98ec-f769-4cfd-90d8-667479d6efef tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:54.968538 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b2db98ec-f769-4cfd-90d8-667479d6efef tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:54.969350 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b2db98ec-f769-4cfd-90d8-667479d6efef tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:54.969806 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b2db98ec-f769-4cfd-90d8-667479d6efef tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:55.110761 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-b2db98ec-f769-4cfd-90d8-667479d6efef tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:55.118026 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-b2db98ec-f769-4cfd-90d8-667479d6efef tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.168724 Feb 09 13:13:55.118611 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 197/407] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:54 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:55.234216 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-7562de4c-9ccc-4918-af62-4a24117330ed tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:55.234883 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-7562de4c-9ccc-4918-af62-4a24117330ed tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:55.241758 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7562de4c-9ccc-4918-af62-4a24117330ed tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:55.242315 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7562de4c-9ccc-4918-af62-4a24117330ed tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:55.243875 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7562de4c-9ccc-4918-af62-4a24117330ed tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:55.244315 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7562de4c-9ccc-4918-af62-4a24117330ed tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:55.348081 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-4c55f8ee-9b16-43d0-a316-a069d0d565ab tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:55.348702 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-4c55f8ee-9b16-43d0-a316-a069d0d565ab tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:55.355137 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4c55f8ee-9b16-43d0-a316-a069d0d565ab tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:55.355586 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4c55f8ee-9b16-43d0-a316-a069d0d565ab tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:55.356380 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4c55f8ee-9b16-43d0-a316-a069d0d565ab tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:55.356823 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4c55f8ee-9b16-43d0-a316-a069d0d565ab tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:55.376182 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-7562de4c-9ccc-4918-af62-4a24117330ed tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:55.384013 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-7562de4c-9ccc-4918-af62-4a24117330ed tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1725 microversion: 2.1 time: 0.153507 Feb 09 13:13:55.384582 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 211/408] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:55 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:55.487720 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-4c55f8ee-9b16-43d0-a316-a069d0d565ab tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:55.494839 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-4c55f8ee-9b16-43d0-a316-a069d0d565ab tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1330 microversion: 2.1 time: 0.150545 Feb 09 13:13:55.495406 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 198/409] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:55 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1330 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:13:56.138750 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-7af48d1c-d776-4c5c-96ef-b2b16ff512dc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:56.139372 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-7af48d1c-d776-4c5c-96ef-b2b16ff512dc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:56.146140 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7af48d1c-d776-4c5c-96ef-b2b16ff512dc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:56.146633 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7af48d1c-d776-4c5c-96ef-b2b16ff512dc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:56.147440 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7af48d1c-d776-4c5c-96ef-b2b16ff512dc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:56.147873 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7af48d1c-d776-4c5c-96ef-b2b16ff512dc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:56.401709 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d9fa2f09-c0bf-473b-ac7d-27e2857caf5a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:56.402115 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d9fa2f09-c0bf-473b-ac7d-27e2857caf5a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:56.408617 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d9fa2f09-c0bf-473b-ac7d-27e2857caf5a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:56.409075 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d9fa2f09-c0bf-473b-ac7d-27e2857caf5a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:56.409931 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d9fa2f09-c0bf-473b-ac7d-27e2857caf5a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:56.410379 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d9fa2f09-c0bf-473b-ac7d-27e2857caf5a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:56.412466 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-7af48d1c-d776-4c5c-96ef-b2b16ff512dc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:56.424037 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-7af48d1c-d776-4c5c-96ef-b2b16ff512dc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.290699 Feb 09 13:13:56.429990 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 212/410] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:56 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:56.517385 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-bd2dd5ed-7d7b-4898-97bb-33240f453fe9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:56.518984 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-bd2dd5ed-7d7b-4898-97bb-33240f453fe9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:56.535620 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bd2dd5ed-7d7b-4898-97bb-33240f453fe9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:56.536137 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bd2dd5ed-7d7b-4898-97bb-33240f453fe9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:56.537047 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bd2dd5ed-7d7b-4898-97bb-33240f453fe9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:56.537520 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bd2dd5ed-7d7b-4898-97bb-33240f453fe9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:56.744521 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-d9fa2f09-c0bf-473b-ac7d-27e2857caf5a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:56.787317 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d9fa2f09-c0bf-473b-ac7d-27e2857caf5a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1725 microversion: 2.1 time: 0.390085 Feb 09 13:13:56.794234 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 199/411] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:56 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1725 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:13:56.820693 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-bd2dd5ed-7d7b-4898-97bb-33240f453fe9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:56.830768 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-bd2dd5ed-7d7b-4898-97bb-33240f453fe9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1318 microversion: 2.1 time: 0.321470 Feb 09 13:13:56.831787 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 213/412] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:56 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:56.925407 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-94a40c5d-b68d-4cb5-9020-e6d804c79002 req-5ad1d9bf-b470-4764-b5b3-4051bab805b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982d841e-c5c6-44a9-9982-44f8cc31b618", "tag": "aa6d2832-0830-44ab-bdba-ad1e71f0308b"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:13:56.927990 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:13:56.927990 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:13:56.937100 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-94a40c5d-b68d-4cb5-9020-e6d804c79002 req-5ad1d9bf-b470-4764-b5b3-4051bab805b3 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:56.937613 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-94a40c5d-b68d-4cb5-9020-e6d804c79002 req-5ad1d9bf-b470-4764-b5b3-4051bab805b3 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:56.950677 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-94a40c5d-b68d-4cb5-9020-e6d804c79002 req-5ad1d9bf-b470-4764-b5b3-4051bab805b3 service nova] Creating event network-changed:aa6d2832-0830-44ab-bdba-ad1e71f0308b for instance 982d841e-c5c6-44a9-9982-44f8cc31b618 on hv-cinder-82786 Feb 09 13:13:56.958677 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-94a40c5d-b68d-4cb5-9020-e6d804c79002 req-5ad1d9bf-b470-4764-b5b3-4051bab805b3 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041994 Feb 09 13:13:56.959719 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 200/413] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:13:57.005750 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-52ac2369-ed27-42e7-9a1b-8afb6fd90476 req-1a26b437-ea38-4aad-987f-9e7479014250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed41059-48cc-4ddb-9a00-62f0c71f7dcb", "tag": "5ce76bf6-0f9b-4cfe-bf46-e82256a2d39f"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:13:57.007674 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:13:57.007674 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:13:57.020763 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-52ac2369-ed27-42e7-9a1b-8afb6fd90476 req-1a26b437-ea38-4aad-987f-9e7479014250 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:57.021434 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-52ac2369-ed27-42e7-9a1b-8afb6fd90476 req-1a26b437-ea38-4aad-987f-9e7479014250 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:57.035577 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-52ac2369-ed27-42e7-9a1b-8afb6fd90476 req-1a26b437-ea38-4aad-987f-9e7479014250 service nova] Creating event network-changed:5ce76bf6-0f9b-4cfe-bf46-e82256a2d39f for instance bed41059-48cc-4ddb-9a00-62f0c71f7dcb on hv-cinder-82786 Feb 09 13:13:57.041735 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-52ac2369-ed27-42e7-9a1b-8afb6fd90476 req-1a26b437-ea38-4aad-987f-9e7479014250 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040765 Feb 09 13:13:57.042547 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 214/414] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:13:57.439977 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-b996f3fc-4c06-48eb-a92e-00ee77c1db21 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:57.440900 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-b996f3fc-4c06-48eb-a92e-00ee77c1db21 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:57.449031 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b996f3fc-4c06-48eb-a92e-00ee77c1db21 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:57.449768 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b996f3fc-4c06-48eb-a92e-00ee77c1db21 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:57.451205 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b996f3fc-4c06-48eb-a92e-00ee77c1db21 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:57.451838 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b996f3fc-4c06-48eb-a92e-00ee77c1db21 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:57.812136 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-1372e5bc-3190-445a-bc58-f24b4e21e64a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:57.817272 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-1372e5bc-3190-445a-bc58-f24b4e21e64a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:57.819435 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1372e5bc-3190-445a-bc58-f24b4e21e64a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:57.820409 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1372e5bc-3190-445a-bc58-f24b4e21e64a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:57.822034 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1372e5bc-3190-445a-bc58-f24b4e21e64a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:57.822792 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1372e5bc-3190-445a-bc58-f24b4e21e64a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:57.863207 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-b996f3fc-4c06-48eb-a92e-00ee77c1db21 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:57.872459 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-b996f3fc-4c06-48eb-a92e-00ee77c1db21 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.436289 Feb 09 13:13:57.873083 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 201/415] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:57 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:57.879378 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-51b83ef3-85b4-4d5f-bc67-c645dddae30e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:57.880332 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-51b83ef3-85b4-4d5f-bc67-c645dddae30e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:57.887098 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-51b83ef3-85b4-4d5f-bc67-c645dddae30e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:57.887549 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-51b83ef3-85b4-4d5f-bc67-c645dddae30e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:57.888572 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-51b83ef3-85b4-4d5f-bc67-c645dddae30e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:57.888873 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-51b83ef3-85b4-4d5f-bc67-c645dddae30e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:57.974898 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-1372e5bc-3190-445a-bc58-f24b4e21e64a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:57.988744 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-1372e5bc-3190-445a-bc58-f24b4e21e64a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1725 microversion: 2.1 time: 0.180984 Feb 09 13:13:57.989317 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 215/416] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:57 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:57.996454 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-654859b6-6607-4f7e-955b-9ffbe77a2286 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:13:57.997657 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-654859b6-6607-4f7e-955b-9ffbe77a2286 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:58.003603 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-654859b6-6607-4f7e-955b-9ffbe77a2286 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:58.004055 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-654859b6-6607-4f7e-955b-9ffbe77a2286 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:58.004843 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-654859b6-6607-4f7e-955b-9ffbe77a2286 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:58.005280 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-654859b6-6607-4f7e-955b-9ffbe77a2286 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:58.032342 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-654859b6-6607-4f7e-955b-9ffbe77a2286 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lazy-loading 'flavor' on Instance uuid 6851d5fe-b010-49cc-8696-19a1008c2beb {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:13:58.034996 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-51b83ef3-85b4-4d5f-bc67-c645dddae30e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:58.042943 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-51b83ef3-85b4-4d5f-bc67-c645dddae30e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1318 microversion: 2.1 time: 0.168667 Feb 09 13:13:58.043509 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 202/417] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:57 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:58.376273 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-654859b6-6607-4f7e-955b-9ffbe77a2286 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "POST /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/action" status: 200 len: 32 microversion: 2.1 time: 0.383920 Feb 09 13:13:58.376882 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 216/418] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Feb 9 13:13:57 2022] POST /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/action => generated 32 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 09 13:13:58.386367 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d0f2f939-d09b-41c8-bdab-d52dc49d13b0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:58.387001 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d0f2f939-d09b-41c8-bdab-d52dc49d13b0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:58.393158 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d0f2f939-d09b-41c8-bdab-d52dc49d13b0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:58.393606 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d0f2f939-d09b-41c8-bdab-d52dc49d13b0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:58.394381 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d0f2f939-d09b-41c8-bdab-d52dc49d13b0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:58.394837 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d0f2f939-d09b-41c8-bdab-d52dc49d13b0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:58.525000 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-d0f2f939-d09b-41c8-bdab-d52dc49d13b0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:58.532879 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d0f2f939-d09b-41c8-bdab-d52dc49d13b0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.150868 Feb 09 13:13:58.533448 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 203/419] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:58 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:58.889859 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-2bb14f32-48cc-47f7-a0f2-cd99ffde0886 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:58.890665 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-2bb14f32-48cc-47f7-a0f2-cd99ffde0886 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:58.897059 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2bb14f32-48cc-47f7-a0f2-cd99ffde0886 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:58.897513 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2bb14f32-48cc-47f7-a0f2-cd99ffde0886 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:58.898308 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2bb14f32-48cc-47f7-a0f2-cd99ffde0886 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:58.898800 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2bb14f32-48cc-47f7-a0f2-cd99ffde0886 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:59.006081 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-51ebd525-cc43-4bc6-bbc5-ceb0b02868cc tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:59.006758 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-51ebd525-cc43-4bc6-bbc5-ceb0b02868cc tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:59.013128 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-51ebd525-cc43-4bc6-bbc5-ceb0b02868cc tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:59.013585 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-51ebd525-cc43-4bc6-bbc5-ceb0b02868cc tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:59.014376 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-51ebd525-cc43-4bc6-bbc5-ceb0b02868cc tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:59.014845 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-51ebd525-cc43-4bc6-bbc5-ceb0b02868cc tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:59.034010 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-2bb14f32-48cc-47f7-a0f2-cd99ffde0886 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:59.041769 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-2bb14f32-48cc-47f7-a0f2-cd99ffde0886 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.156307 Feb 09 13:13:59.042348 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 217/420] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:58 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:59.059289 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-abdc9f9f-dca9-4348-b1ca-33a8249b58b9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:59.059892 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-abdc9f9f-dca9-4348-b1ca-33a8249b58b9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:59.065695 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-abdc9f9f-dca9-4348-b1ca-33a8249b58b9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:59.066137 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-abdc9f9f-dca9-4348-b1ca-33a8249b58b9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:59.066957 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-abdc9f9f-dca9-4348-b1ca-33a8249b58b9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:59.067383 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-abdc9f9f-dca9-4348-b1ca-33a8249b58b9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:59.151418 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-51ebd525-cc43-4bc6-bbc5-ceb0b02868cc tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:59.161082 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-51ebd525-cc43-4bc6-bbc5-ceb0b02868cc tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1725 microversion: 2.1 time: 0.158574 Feb 09 13:13:59.161664 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 204/421] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:59 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:13:59.199095 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-abdc9f9f-dca9-4348-b1ca-33a8249b58b9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:59.207106 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-abdc9f9f-dca9-4348-b1ca-33a8249b58b9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1318 microversion: 2.1 time: 0.150618 Feb 09 13:13:59.207106 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 218/422] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:59 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:13:59.548991 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8c66693a-ca9f-4eea-a51c-cee55277fb7b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:13:59.549630 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8c66693a-ca9f-4eea-a51c-cee55277fb7b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:13:59.556291 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8c66693a-ca9f-4eea-a51c-cee55277fb7b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:59.558848 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8c66693a-ca9f-4eea-a51c-cee55277fb7b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:59.558848 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8c66693a-ca9f-4eea-a51c-cee55277fb7b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:13:59.558848 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8c66693a-ca9f-4eea-a51c-cee55277fb7b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:13:59.688707 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8c66693a-ca9f-4eea-a51c-cee55277fb7b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:13:59.696474 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8c66693a-ca9f-4eea-a51c-cee55277fb7b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.151372 Feb 09 13:13:59.697059 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 205/423] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:13:59 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:00.058122 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-81a9d472-07de-471b-92d4-6a6a52740f52 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:00.058772 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-81a9d472-07de-471b-92d4-6a6a52740f52 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:00.064951 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-81a9d472-07de-471b-92d4-6a6a52740f52 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:00.068025 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-81a9d472-07de-471b-92d4-6a6a52740f52 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:00.068025 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-81a9d472-07de-471b-92d4-6a6a52740f52 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:00.068025 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-81a9d472-07de-471b-92d4-6a6a52740f52 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:00.177972 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-6bc179c6-c341-4e98-9cf1-b4127825c128 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:00.178487 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-6bc179c6-c341-4e98-9cf1-b4127825c128 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:00.184933 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6bc179c6-c341-4e98-9cf1-b4127825c128 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:00.185379 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6bc179c6-c341-4e98-9cf1-b4127825c128 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:00.186165 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6bc179c6-c341-4e98-9cf1-b4127825c128 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:00.186622 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6bc179c6-c341-4e98-9cf1-b4127825c128 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:00.198630 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-81a9d472-07de-471b-92d4-6a6a52740f52 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:00.205767 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-81a9d472-07de-471b-92d4-6a6a52740f52 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.151345 Feb 09 13:14:00.206580 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 219/424] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:00 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:00.223476 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-5c6f9d02-2371-4491-a4d1-a282425701f1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:00.224074 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-5c6f9d02-2371-4491-a4d1-a282425701f1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:00.230005 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5c6f9d02-2371-4491-a4d1-a282425701f1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:00.230446 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5c6f9d02-2371-4491-a4d1-a282425701f1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:00.231243 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5c6f9d02-2371-4491-a4d1-a282425701f1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:00.231681 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5c6f9d02-2371-4491-a4d1-a282425701f1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:00.320890 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6bc179c6-c341-4e98-9cf1-b4127825c128 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:00.332876 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-6bc179c6-c341-4e98-9cf1-b4127825c128 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1725 microversion: 2.1 time: 0.158702 Feb 09 13:14:00.333456 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 206/425] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:00 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:00.370918 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-5c6f9d02-2371-4491-a4d1-a282425701f1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:00.378975 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-5c6f9d02-2371-4491-a4d1-a282425701f1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1318 microversion: 2.1 time: 0.158941 Feb 09 13:14:00.379545 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 220/426] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:00 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:00.713647 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-74e0607c-d6bd-4382-b2ea-015526dd4059 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:00.714245 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-74e0607c-d6bd-4382-b2ea-015526dd4059 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:00.720319 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-74e0607c-d6bd-4382-b2ea-015526dd4059 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:00.720774 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-74e0607c-d6bd-4382-b2ea-015526dd4059 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:00.721565 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-74e0607c-d6bd-4382-b2ea-015526dd4059 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:00.722100 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-74e0607c-d6bd-4382-b2ea-015526dd4059 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:00.853162 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-74e0607c-d6bd-4382-b2ea-015526dd4059 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:00.860703 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-74e0607c-d6bd-4382-b2ea-015526dd4059 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.151357 Feb 09 13:14:00.861266 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 207/427] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:00 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:01.222246 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-a7ba6a2a-67ad-400c-a92c-64c7cf22b6a2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:01.222974 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-a7ba6a2a-67ad-400c-a92c-64c7cf22b6a2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:01.229534 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a7ba6a2a-67ad-400c-a92c-64c7cf22b6a2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:01.230002 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a7ba6a2a-67ad-400c-a92c-64c7cf22b6a2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:01.230836 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a7ba6a2a-67ad-400c-a92c-64c7cf22b6a2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:01.231317 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a7ba6a2a-67ad-400c-a92c-64c7cf22b6a2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:01.351558 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-50145967-f423-41b5-a226-32799a913f7c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:01.352823 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-50145967-f423-41b5-a226-32799a913f7c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:01.358687 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-50145967-f423-41b5-a226-32799a913f7c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:01.359401 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-50145967-f423-41b5-a226-32799a913f7c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:01.360198 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-50145967-f423-41b5-a226-32799a913f7c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:01.360632 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-50145967-f423-41b5-a226-32799a913f7c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:01.388933 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a7ba6a2a-67ad-400c-a92c-64c7cf22b6a2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:01.397300 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-a7ba6a2a-67ad-400c-a92c-64c7cf22b6a2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.178673 Feb 09 13:14:01.397885 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 221/428] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:01 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:01.402817 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-ab986270-149c-4219-bdb1-f43496da7a04 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:01.404154 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-ab986270-149c-4219-bdb1-f43496da7a04 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:01.410146 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ab986270-149c-4219-bdb1-f43496da7a04 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:01.410698 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ab986270-149c-4219-bdb1-f43496da7a04 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:01.411561 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ab986270-149c-4219-bdb1-f43496da7a04 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:01.412089 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ab986270-149c-4219-bdb1-f43496da7a04 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:01.569032 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ab986270-149c-4219-bdb1-f43496da7a04 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:01.580566 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-ab986270-149c-4219-bdb1-f43496da7a04 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1318 microversion: 2.1 time: 0.181422 Feb 09 13:14:01.586480 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 222/429] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:01 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:01.628851 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-50145967-f423-41b5-a226-32799a913f7c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:01.637446 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-50145967-f423-41b5-a226-32799a913f7c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1725 microversion: 2.1 time: 0.290184 Feb 09 13:14:01.638016 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 208/430] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:01 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1725 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:01.876940 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-646500d9-3f5b-489e-861a-ed37422c7146 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:01.877547 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-646500d9-3f5b-489e-861a-ed37422c7146 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:01.884023 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-646500d9-3f5b-489e-861a-ed37422c7146 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:01.884499 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-646500d9-3f5b-489e-861a-ed37422c7146 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:01.885281 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-646500d9-3f5b-489e-861a-ed37422c7146 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:01.885718 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-646500d9-3f5b-489e-861a-ed37422c7146 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:02.017673 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-646500d9-3f5b-489e-861a-ed37422c7146 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:02.028831 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-646500d9-3f5b-489e-861a-ed37422c7146 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.152708 Feb 09 13:14:02.028831 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 223/431] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:01 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:02.413725 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-9c8b9202-3bc1-4447-a4d8-9c41101c8b27 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:02.414313 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-9c8b9202-3bc1-4447-a4d8-9c41101c8b27 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:02.421034 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9c8b9202-3bc1-4447-a4d8-9c41101c8b27 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:02.421484 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9c8b9202-3bc1-4447-a4d8-9c41101c8b27 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:02.422268 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9c8b9202-3bc1-4447-a4d8-9c41101c8b27 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:02.422745 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9c8b9202-3bc1-4447-a4d8-9c41101c8b27 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:02.560314 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-9c8b9202-3bc1-4447-a4d8-9c41101c8b27 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:02.567628 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-9c8b9202-3bc1-4447-a4d8-9c41101c8b27 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.157680 Feb 09 13:14:02.571435 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 209/432] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:02 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:02.600325 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-0a3d41bd-8c0a-444c-b50f-6d7d6b69b009 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:02.600961 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-0a3d41bd-8c0a-444c-b50f-6d7d6b69b009 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:02.608991 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0a3d41bd-8c0a-444c-b50f-6d7d6b69b009 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:02.609443 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0a3d41bd-8c0a-444c-b50f-6d7d6b69b009 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:02.610230 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0a3d41bd-8c0a-444c-b50f-6d7d6b69b009 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:02.611993 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0a3d41bd-8c0a-444c-b50f-6d7d6b69b009 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:02.654610 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-5ef88c3d-ff20-40d8-8cc0-98e21c469b42 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:02.655257 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-5ef88c3d-ff20-40d8-8cc0-98e21c469b42 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:02.661232 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5ef88c3d-ff20-40d8-8cc0-98e21c469b42 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:02.663259 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5ef88c3d-ff20-40d8-8cc0-98e21c469b42 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:02.663259 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5ef88c3d-ff20-40d8-8cc0-98e21c469b42 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:02.663259 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5ef88c3d-ff20-40d8-8cc0-98e21c469b42 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:02.758688 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-0a3d41bd-8c0a-444c-b50f-6d7d6b69b009 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:02.766571 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-0a3d41bd-8c0a-444c-b50f-6d7d6b69b009 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1318 microversion: 2.1 time: 0.171566 Feb 09 13:14:02.767234 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 224/433] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:02 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:02.814851 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-5ef88c3d-ff20-40d8-8cc0-98e21c469b42 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:02.823479 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-5ef88c3d-ff20-40d8-8cc0-98e21c469b42 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1702 microversion: 2.1 time: 0.171914 Feb 09 13:14:02.824064 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 210/434] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:02 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1702 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:02.842706 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-6940325f-b6fa-4315-a61b-ff3ca99c3f69 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:14:02.849289 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6940325f-b6fa-4315-a61b-ff3ca99c3f69 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:02.849815 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6940325f-b6fa-4315-a61b-ff3ca99c3f69 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:02.911104 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-6940325f-b6fa-4315-a61b-ff3ca99c3f69 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Going to try to start instance {{(pid=116748) start /opt/stack/nova/nova/compute/api.py:2678}} Feb 09 13:14:03.043002 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-83671f86-90d8-4312-b3b7-835e39a66174 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:03.043698 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-83671f86-90d8-4312-b3b7-835e39a66174 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:03.049716 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-83671f86-90d8-4312-b3b7-835e39a66174 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:03.052963 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-83671f86-90d8-4312-b3b7-835e39a66174 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:03.052963 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-83671f86-90d8-4312-b3b7-835e39a66174 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:03.052963 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-83671f86-90d8-4312-b3b7-835e39a66174 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:03.135884 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-6940325f-b6fa-4315-a61b-ff3ca99c3f69 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "POST /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991/action" status: 202 len: 0 microversion: 2.1 time: 0.297014 Feb 09 13:14:03.136735 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 225/435] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Feb 9 13:14:02 2022] POST /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:14:03.145637 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-4a2ca772-78bb-4bc9-bb07-43fc95516cd3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:03.146333 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-4a2ca772-78bb-4bc9-bb07-43fc95516cd3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:03.152610 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4a2ca772-78bb-4bc9-bb07-43fc95516cd3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:03.153099 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4a2ca772-78bb-4bc9-bb07-43fc95516cd3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:03.153886 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4a2ca772-78bb-4bc9-bb07-43fc95516cd3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:03.154324 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4a2ca772-78bb-4bc9-bb07-43fc95516cd3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:03.189374 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-83671f86-90d8-4312-b3b7-835e39a66174 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:03.197340 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-83671f86-90d8-4312-b3b7-835e39a66174 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.158487 Feb 09 13:14:03.201248 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 211/436] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:03 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:03.294373 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-4a2ca772-78bb-4bc9-bb07-43fc95516cd3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:03.303378 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-4a2ca772-78bb-4bc9-bb07-43fc95516cd3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1711 microversion: 2.1 time: 0.162445 Feb 09 13:14:03.306590 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 226/437] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:03 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1711 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:03.584773 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8a453511-0d67-4df3-9c91-af037411d1bc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:03.585455 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8a453511-0d67-4df3-9c91-af037411d1bc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:03.592855 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8a453511-0d67-4df3-9c91-af037411d1bc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:03.593650 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8a453511-0d67-4df3-9c91-af037411d1bc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:03.594458 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8a453511-0d67-4df3-9c91-af037411d1bc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:03.595079 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8a453511-0d67-4df3-9c91-af037411d1bc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:03.784398 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-e9eeb428-0c0f-4040-912d-492520fdc0eb tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:03.784958 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-e9eeb428-0c0f-4040-912d-492520fdc0eb tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:03.792184 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e9eeb428-0c0f-4040-912d-492520fdc0eb tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:03.792692 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e9eeb428-0c0f-4040-912d-492520fdc0eb tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:03.793505 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e9eeb428-0c0f-4040-912d-492520fdc0eb tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:03.793929 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e9eeb428-0c0f-4040-912d-492520fdc0eb tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:03.809704 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8a453511-0d67-4df3-9c91-af037411d1bc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:03.819729 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8a453511-0d67-4df3-9c91-af037411d1bc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.238925 Feb 09 13:14:03.820337 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 212/438] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:03 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:03.932012 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e9eeb428-0c0f-4040-912d-492520fdc0eb tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:03.939400 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-e9eeb428-0c0f-4040-912d-492520fdc0eb tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1318 microversion: 2.1 time: 0.158955 Feb 09 13:14:03.939978 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 227/439] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:03 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:04.215381 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-92ad8c53-63f7-47b9-b6f0-7b85ae87fe2f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:04.219037 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-92ad8c53-63f7-47b9-b6f0-7b85ae87fe2f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:04.222138 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-92ad8c53-63f7-47b9-b6f0-7b85ae87fe2f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:04.222732 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-92ad8c53-63f7-47b9-b6f0-7b85ae87fe2f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:04.223324 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-92ad8c53-63f7-47b9-b6f0-7b85ae87fe2f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:04.223758 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-92ad8c53-63f7-47b9-b6f0-7b85ae87fe2f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:04.320729 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-b9f28b6a-718a-4131-88d4-431ae5383462 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:04.321432 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-b9f28b6a-718a-4131-88d4-431ae5383462 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:04.327759 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b9f28b6a-718a-4131-88d4-431ae5383462 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:04.328206 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b9f28b6a-718a-4131-88d4-431ae5383462 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:04.328980 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b9f28b6a-718a-4131-88d4-431ae5383462 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:04.329413 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b9f28b6a-718a-4131-88d4-431ae5383462 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:04.367795 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-92ad8c53-63f7-47b9-b6f0-7b85ae87fe2f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:04.376338 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-92ad8c53-63f7-47b9-b6f0-7b85ae87fe2f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.165147 Feb 09 13:14:04.376920 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 213/440] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:04 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:04.468846 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-b9f28b6a-718a-4131-88d4-431ae5383462 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:04.476694 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-b9f28b6a-718a-4131-88d4-431ae5383462 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1711 microversion: 2.1 time: 0.159556 Feb 09 13:14:04.477266 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 228/441] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:04 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1711 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:04.837046 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-e09d6194-2fc5-4ea3-b8b2-f776046129d9 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:04.837585 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-e09d6194-2fc5-4ea3-b8b2-f776046129d9 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:04.843852 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e09d6194-2fc5-4ea3-b8b2-f776046129d9 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:04.844299 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e09d6194-2fc5-4ea3-b8b2-f776046129d9 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:04.845076 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e09d6194-2fc5-4ea3-b8b2-f776046129d9 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:04.845510 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e09d6194-2fc5-4ea3-b8b2-f776046129d9 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:04.966937 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-ab1aa317-95c3-46cd-8f07-dea061bc7c6e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:04.967429 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-ab1aa317-95c3-46cd-8f07-dea061bc7c6e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:04.973677 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ab1aa317-95c3-46cd-8f07-dea061bc7c6e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:04.974133 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ab1aa317-95c3-46cd-8f07-dea061bc7c6e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:04.974953 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ab1aa317-95c3-46cd-8f07-dea061bc7c6e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:04.975390 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ab1aa317-95c3-46cd-8f07-dea061bc7c6e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:04.977880 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-e09d6194-2fc5-4ea3-b8b2-f776046129d9 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:04.986822 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-e09d6194-2fc5-4ea3-b8b2-f776046129d9 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.153386 Feb 09 13:14:04.987512 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 214/442] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:04 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:05.118493 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ab1aa317-95c3-46cd-8f07-dea061bc7c6e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:05.125762 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-ab1aa317-95c3-46cd-8f07-dea061bc7c6e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1318 microversion: 2.1 time: 0.163253 Feb 09 13:14:05.126329 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 229/443] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:04 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:05.393958 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-96ebeedf-e38b-47ff-8b41-7c436856dab0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:05.394696 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-96ebeedf-e38b-47ff-8b41-7c436856dab0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:05.400680 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-96ebeedf-e38b-47ff-8b41-7c436856dab0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:05.401128 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-96ebeedf-e38b-47ff-8b41-7c436856dab0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:05.401926 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-96ebeedf-e38b-47ff-8b41-7c436856dab0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:05.402341 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-96ebeedf-e38b-47ff-8b41-7c436856dab0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:05.495749 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-77bdc0f3-f3c3-4ffb-b99b-39b721216bf6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:05.496733 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-77bdc0f3-f3c3-4ffb-b99b-39b721216bf6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:05.502793 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-77bdc0f3-f3c3-4ffb-b99b-39b721216bf6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:05.503455 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-77bdc0f3-f3c3-4ffb-b99b-39b721216bf6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:05.504592 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-77bdc0f3-f3c3-4ffb-b99b-39b721216bf6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:05.505608 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-77bdc0f3-f3c3-4ffb-b99b-39b721216bf6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:05.546994 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-96ebeedf-e38b-47ff-8b41-7c436856dab0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:05.555864 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-96ebeedf-e38b-47ff-8b41-7c436856dab0 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.165533 Feb 09 13:14:05.556450 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 215/444] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:05 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:05.652349 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-77bdc0f3-f3c3-4ffb-b99b-39b721216bf6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:05.660146 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-77bdc0f3-f3c3-4ffb-b99b-39b721216bf6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1711 microversion: 2.1 time: 0.170758 Feb 09 13:14:05.660718 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 230/445] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:05 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1711 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:06.003669 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-9a937d42-c741-4703-85df-a828637a1e13 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:06.004640 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-9a937d42-c741-4703-85df-a828637a1e13 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:06.013717 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9a937d42-c741-4703-85df-a828637a1e13 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:06.014170 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9a937d42-c741-4703-85df-a828637a1e13 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:06.014987 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9a937d42-c741-4703-85df-a828637a1e13 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:06.015424 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9a937d42-c741-4703-85df-a828637a1e13 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:06.141479 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-1ccef639-0887-4b2d-8bec-e2f88776644f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:06.142656 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-1ccef639-0887-4b2d-8bec-e2f88776644f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:06.151472 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1ccef639-0887-4b2d-8bec-e2f88776644f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:06.152079 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1ccef639-0887-4b2d-8bec-e2f88776644f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:06.152945 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1ccef639-0887-4b2d-8bec-e2f88776644f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:06.153451 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1ccef639-0887-4b2d-8bec-e2f88776644f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:06.170391 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-9a937d42-c741-4703-85df-a828637a1e13 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:06.177637 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-9a937d42-c741-4703-85df-a828637a1e13 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.178156 Feb 09 13:14:06.178207 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 216/446] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:05 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:06.288267 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-1ccef639-0887-4b2d-8bec-e2f88776644f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:06.295946 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-1ccef639-0887-4b2d-8bec-e2f88776644f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1318 microversion: 2.1 time: 0.158498 Feb 09 13:14:06.296510 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 231/447] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:06 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:06.572924 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-92f5b692-7103-491c-83ab-22bfcd6c7b1d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:06.573539 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-92f5b692-7103-491c-83ab-22bfcd6c7b1d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:06.579409 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-92f5b692-7103-491c-83ab-22bfcd6c7b1d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:06.579877 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-92f5b692-7103-491c-83ab-22bfcd6c7b1d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:06.580664 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-92f5b692-7103-491c-83ab-22bfcd6c7b1d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:06.581107 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-92f5b692-7103-491c-83ab-22bfcd6c7b1d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:06.676984 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-4eb56da3-8f12-466b-92bc-b44a3575857d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:06.677588 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-4eb56da3-8f12-466b-92bc-b44a3575857d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:06.683332 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4eb56da3-8f12-466b-92bc-b44a3575857d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:06.683781 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4eb56da3-8f12-466b-92bc-b44a3575857d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:06.684553 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4eb56da3-8f12-466b-92bc-b44a3575857d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:06.684986 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4eb56da3-8f12-466b-92bc-b44a3575857d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:06.719967 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-92f5b692-7103-491c-83ab-22bfcd6c7b1d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:06.727848 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-92f5b692-7103-491c-83ab-22bfcd6c7b1d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.158541 Feb 09 13:14:06.728423 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 217/448] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:06 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:06.829513 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-4eb56da3-8f12-466b-92bc-b44a3575857d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:06.837687 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-4eb56da3-8f12-466b-92bc-b44a3575857d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1711 microversion: 2.1 time: 0.164367 Feb 09 13:14:06.839046 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 232/449] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:06 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1711 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:07.196160 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-97d57d92-9178-4bd2-ab8a-e0d04f734abb tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:07.196919 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-97d57d92-9178-4bd2-ab8a-e0d04f734abb tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:07.206391 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-97d57d92-9178-4bd2-ab8a-e0d04f734abb tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:07.207164 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-97d57d92-9178-4bd2-ab8a-e0d04f734abb tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:07.208252 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-97d57d92-9178-4bd2-ab8a-e0d04f734abb tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:07.208440 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-97d57d92-9178-4bd2-ab8a-e0d04f734abb tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:07.311962 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-7cc55cf9-0d47-4481-acef-d2e9fbafcd5b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:07.312833 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-7cc55cf9-0d47-4481-acef-d2e9fbafcd5b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:07.319614 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7cc55cf9-0d47-4481-acef-d2e9fbafcd5b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:07.320227 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7cc55cf9-0d47-4481-acef-d2e9fbafcd5b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:07.321009 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7cc55cf9-0d47-4481-acef-d2e9fbafcd5b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:07.321599 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7cc55cf9-0d47-4481-acef-d2e9fbafcd5b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:07.362492 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-97d57d92-9178-4bd2-ab8a-e0d04f734abb tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:07.370691 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-97d57d92-9178-4bd2-ab8a-e0d04f734abb tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.178852 Feb 09 13:14:07.371812 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 218/450] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:07 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:07.471400 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-7cc55cf9-0d47-4481-acef-d2e9fbafcd5b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:07.479583 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-7cc55cf9-0d47-4481-acef-d2e9fbafcd5b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1318 microversion: 2.1 time: 0.170642 Feb 09 13:14:07.480381 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 233/451] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:07 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:07.746359 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-378a57a6-1ce5-4db2-a790-c938cbc90a79 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:07.747613 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-378a57a6-1ce5-4db2-a790-c938cbc90a79 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:07.757500 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-378a57a6-1ce5-4db2-a790-c938cbc90a79 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:07.757500 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-378a57a6-1ce5-4db2-a790-c938cbc90a79 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:07.758215 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-378a57a6-1ce5-4db2-a790-c938cbc90a79 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:07.758641 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-378a57a6-1ce5-4db2-a790-c938cbc90a79 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:07.855897 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-33722d41-15ee-472e-86ae-161bf19e91e1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:07.856502 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-33722d41-15ee-472e-86ae-161bf19e91e1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:07.862510 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-33722d41-15ee-472e-86ae-161bf19e91e1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:07.863495 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-33722d41-15ee-472e-86ae-161bf19e91e1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:07.863757 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-33722d41-15ee-472e-86ae-161bf19e91e1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:07.864185 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-33722d41-15ee-472e-86ae-161bf19e91e1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:07.905535 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-378a57a6-1ce5-4db2-a790-c938cbc90a79 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:07.913605 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-378a57a6-1ce5-4db2-a790-c938cbc90a79 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.172154 Feb 09 13:14:07.914189 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 219/452] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:07 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:08.003298 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-33722d41-15ee-472e-86ae-161bf19e91e1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:08.011041 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-33722d41-15ee-472e-86ae-161bf19e91e1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1711 microversion: 2.1 time: 0.159387 Feb 09 13:14:08.011617 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 234/453] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:07 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1711 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:08.391604 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-a941cded-0ad6-4802-8e23-d7830fa112e9 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:08.392705 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-a941cded-0ad6-4802-8e23-d7830fa112e9 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:08.403616 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a941cded-0ad6-4802-8e23-d7830fa112e9 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:08.404442 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a941cded-0ad6-4802-8e23-d7830fa112e9 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:08.405874 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a941cded-0ad6-4802-8e23-d7830fa112e9 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:08.406729 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a941cded-0ad6-4802-8e23-d7830fa112e9 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:08.496788 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-fdb53930-674c-41de-9a4d-040bae806165 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:08.497408 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-fdb53930-674c-41de-9a4d-040bae806165 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:08.503710 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fdb53930-674c-41de-9a4d-040bae806165 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:08.504162 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fdb53930-674c-41de-9a4d-040bae806165 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:08.504957 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fdb53930-674c-41de-9a4d-040bae806165 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:08.505396 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fdb53930-674c-41de-9a4d-040bae806165 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:08.546615 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-a941cded-0ad6-4802-8e23-d7830fa112e9 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:08.554419 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-a941cded-0ad6-4802-8e23-d7830fa112e9 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.167835 Feb 09 13:14:08.555070 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 220/454] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:08 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:08.647633 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-fdb53930-674c-41de-9a4d-040bae806165 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:08.655522 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-fdb53930-674c-41de-9a4d-040bae806165 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1318 microversion: 2.1 time: 0.163069 Feb 09 13:14:08.656095 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 235/455] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:08 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:08.930876 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-0f05e8eb-0e6a-4b77-8bf6-ec4e821983b2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:08.931497 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-0f05e8eb-0e6a-4b77-8bf6-ec4e821983b2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:08.937724 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0f05e8eb-0e6a-4b77-8bf6-ec4e821983b2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:08.938102 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0f05e8eb-0e6a-4b77-8bf6-ec4e821983b2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:08.939077 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0f05e8eb-0e6a-4b77-8bf6-ec4e821983b2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:08.939484 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0f05e8eb-0e6a-4b77-8bf6-ec4e821983b2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:09.028702 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-8462d872-99a4-470e-b69f-ff58a5e74fcf tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:09.029314 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-8462d872-99a4-470e-b69f-ff58a5e74fcf tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:09.045363 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8462d872-99a4-470e-b69f-ff58a5e74fcf tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:09.045811 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8462d872-99a4-470e-b69f-ff58a5e74fcf tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:09.046638 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8462d872-99a4-470e-b69f-ff58a5e74fcf tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:09.047073 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8462d872-99a4-470e-b69f-ff58a5e74fcf tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:09.113761 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-0f05e8eb-0e6a-4b77-8bf6-ec4e821983b2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:09.122963 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-0f05e8eb-0e6a-4b77-8bf6-ec4e821983b2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.195720 Feb 09 13:14:09.123537 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 221/456] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:08 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:09.128117 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-c264fe41-d416-4edb-a6d1-64e403320158 req-4a2645f4-d3cf-4246-a15f-c55c59cb0ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982d841e-c5c6-44a9-9982-44f8cc31b618", "name": "network-vif-plugged", "status": "completed", "tag": "aa6d2832-0830-44ab-bdba-ad1e71f0308b"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:14:09.129703 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:14:09.129703 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:14:09.137246 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-c264fe41-d416-4edb-a6d1-64e403320158 req-4a2645f4-d3cf-4246-a15f-c55c59cb0ce5 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:09.137685 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-c264fe41-d416-4edb-a6d1-64e403320158 req-4a2645f4-d3cf-4246-a15f-c55c59cb0ce5 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:09.148734 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-c264fe41-d416-4edb-a6d1-64e403320158 req-4a2645f4-d3cf-4246-a15f-c55c59cb0ce5 service nova] Creating event network-vif-plugged:aa6d2832-0830-44ab-bdba-ad1e71f0308b for instance 982d841e-c5c6-44a9-9982-44f8cc31b618 on hv-cinder-82786 Feb 09 13:14:09.154100 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-c264fe41-d416-4edb-a6d1-64e403320158 req-4a2645f4-d3cf-4246-a15f-c55c59cb0ce5 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029436 Feb 09 13:14:09.155465 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 222/457] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:14:09.199352 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-8462d872-99a4-470e-b69f-ff58a5e74fcf tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:09.207494 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-8462d872-99a4-470e-b69f-ff58a5e74fcf tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1715 microversion: 2.1 time: 0.183130 Feb 09 13:14:09.217898 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 236/458] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:09 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1715 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:09.574953 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-f3410b07-a37d-4f30-89a1-2943a2601e88 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:09.575820 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-f3410b07-a37d-4f30-89a1-2943a2601e88 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:09.585755 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f3410b07-a37d-4f30-89a1-2943a2601e88 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:09.586540 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f3410b07-a37d-4f30-89a1-2943a2601e88 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:09.587450 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f3410b07-a37d-4f30-89a1-2943a2601e88 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:09.588134 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f3410b07-a37d-4f30-89a1-2943a2601e88 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:09.672081 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-91963211-05c4-4706-95f2-9e59a3601cb9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:09.672710 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-91963211-05c4-4706-95f2-9e59a3601cb9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:09.679551 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-91963211-05c4-4706-95f2-9e59a3601cb9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:09.680005 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-91963211-05c4-4706-95f2-9e59a3601cb9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:09.680805 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-91963211-05c4-4706-95f2-9e59a3601cb9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:09.681244 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-91963211-05c4-4706-95f2-9e59a3601cb9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:09.730291 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-f3410b07-a37d-4f30-89a1-2943a2601e88 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:09.738221 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-f3410b07-a37d-4f30-89a1-2943a2601e88 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.169547 Feb 09 13:14:09.738882 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 223/459] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:09 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:09.829444 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-91963211-05c4-4706-95f2-9e59a3601cb9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:09.837191 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-91963211-05c4-4706-95f2-9e59a3601cb9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1318 microversion: 2.1 time: 0.168777 Feb 09 13:14:09.837772 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 237/460] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:09 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:10.139253 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-982b9c57-c1dd-47f6-a720-b9fe62a781b5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:10.139770 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-982b9c57-c1dd-47f6-a720-b9fe62a781b5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:10.145685 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-982b9c57-c1dd-47f6-a720-b9fe62a781b5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:10.146132 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-982b9c57-c1dd-47f6-a720-b9fe62a781b5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:10.146952 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-982b9c57-c1dd-47f6-a720-b9fe62a781b5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:10.147393 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-982b9c57-c1dd-47f6-a720-b9fe62a781b5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:10.286701 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-982b9c57-c1dd-47f6-a720-b9fe62a781b5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:10.294423 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-982b9c57-c1dd-47f6-a720-b9fe62a781b5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.158939 Feb 09 13:14:10.295145 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 224/461] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:10 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:10.755818 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-85573d9a-9d33-4377-a13e-65a1e4ffc782 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:10.756432 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-85573d9a-9d33-4377-a13e-65a1e4ffc782 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:10.763248 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-85573d9a-9d33-4377-a13e-65a1e4ffc782 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:10.763737 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-85573d9a-9d33-4377-a13e-65a1e4ffc782 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:10.764638 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-85573d9a-9d33-4377-a13e-65a1e4ffc782 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:10.765117 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-85573d9a-9d33-4377-a13e-65a1e4ffc782 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:10.854149 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-4bb9d37f-7ca4-47b2-bc35-b313584bed37 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:10.855393 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-4bb9d37f-7ca4-47b2-bc35-b313584bed37 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:10.861743 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4bb9d37f-7ca4-47b2-bc35-b313584bed37 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:10.862189 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4bb9d37f-7ca4-47b2-bc35-b313584bed37 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:10.863350 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4bb9d37f-7ca4-47b2-bc35-b313584bed37 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:10.863962 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4bb9d37f-7ca4-47b2-bc35-b313584bed37 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:10.910798 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-85573d9a-9d33-4377-a13e-65a1e4ffc782 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:10.918620 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-85573d9a-9d33-4377-a13e-65a1e4ffc782 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.166757 Feb 09 13:14:10.919196 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 238/462] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:10 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:11.004724 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-4bb9d37f-7ca4-47b2-bc35-b313584bed37 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:11.012909 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-4bb9d37f-7ca4-47b2-bc35-b313584bed37 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1318 microversion: 2.1 time: 0.163071 Feb 09 13:14:11.013410 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 225/463] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:10 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:11.170456 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-a0976eae-f771-45e2-975f-77a83068a98d req-cd1893b5-f65f-4a4c-80c9-b11d591740e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed41059-48cc-4ddb-9a00-62f0c71f7dcb", "name": "network-vif-plugged", "status": "completed", "tag": "5ce76bf6-0f9b-4cfe-bf46-e82256a2d39f"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:14:11.172097 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:14:11.172097 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:14:11.179154 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-a0976eae-f771-45e2-975f-77a83068a98d req-cd1893b5-f65f-4a4c-80c9-b11d591740e9 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:11.179599 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-a0976eae-f771-45e2-975f-77a83068a98d req-cd1893b5-f65f-4a4c-80c9-b11d591740e9 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:11.191044 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-a0976eae-f771-45e2-975f-77a83068a98d req-cd1893b5-f65f-4a4c-80c9-b11d591740e9 service nova] Creating event network-vif-plugged:5ce76bf6-0f9b-4cfe-bf46-e82256a2d39f for instance bed41059-48cc-4ddb-9a00-62f0c71f7dcb on hv-cinder-82786 Feb 09 13:14:11.196113 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-a0976eae-f771-45e2-975f-77a83068a98d req-cd1893b5-f65f-4a4c-80c9-b11d591740e9 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029571 Feb 09 13:14:11.196710 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 239/464] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:14:11.311668 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-9528db45-817e-49db-8177-bee49897acbb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:11.312275 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-9528db45-817e-49db-8177-bee49897acbb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:11.318136 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9528db45-817e-49db-8177-bee49897acbb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:11.318619 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9528db45-817e-49db-8177-bee49897acbb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:11.319402 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9528db45-817e-49db-8177-bee49897acbb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:11.319842 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9528db45-817e-49db-8177-bee49897acbb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:11.465700 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-9528db45-817e-49db-8177-bee49897acbb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:11.474333 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-9528db45-817e-49db-8177-bee49897acbb tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.166290 Feb 09 13:14:11.475053 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 226/465] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:11 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:11.936359 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-06ebf47e-0197-4547-969b-39d2c2b579cc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:11.936980 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-06ebf47e-0197-4547-969b-39d2c2b579cc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:11.943347 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-06ebf47e-0197-4547-969b-39d2c2b579cc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:11.943825 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-06ebf47e-0197-4547-969b-39d2c2b579cc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:11.944671 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-06ebf47e-0197-4547-969b-39d2c2b579cc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:11.945117 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-06ebf47e-0197-4547-969b-39d2c2b579cc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:12.030110 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ff849ba6-5dec-4035-8cba-fb0b8b6a22c9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:12.030960 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-ff849ba6-5dec-4035-8cba-fb0b8b6a22c9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:12.037849 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ff849ba6-5dec-4035-8cba-fb0b8b6a22c9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:12.038462 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ff849ba6-5dec-4035-8cba-fb0b8b6a22c9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:12.039249 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ff849ba6-5dec-4035-8cba-fb0b8b6a22c9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:12.039686 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ff849ba6-5dec-4035-8cba-fb0b8b6a22c9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:12.086375 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-06ebf47e-0197-4547-969b-39d2c2b579cc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:12.094355 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-06ebf47e-0197-4547-969b-39d2c2b579cc tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.162721 Feb 09 13:14:12.094957 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 240/466] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:11 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:12.179222 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ff849ba6-5dec-4035-8cba-fb0b8b6a22c9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:12.186747 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-ff849ba6-5dec-4035-8cba-fb0b8b6a22c9 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1318 microversion: 2.1 time: 0.161898 Feb 09 13:14:12.187250 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 227/467] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:12 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:12.492429 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d57aa144-3c00-4824-9a2d-21880fe22399 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:12.493034 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d57aa144-3c00-4824-9a2d-21880fe22399 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:12.499492 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d57aa144-3c00-4824-9a2d-21880fe22399 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:12.499935 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d57aa144-3c00-4824-9a2d-21880fe22399 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:12.500718 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d57aa144-3c00-4824-9a2d-21880fe22399 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:12.501139 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d57aa144-3c00-4824-9a2d-21880fe22399 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:12.648933 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d57aa144-3c00-4824-9a2d-21880fe22399 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:12.658463 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d57aa144-3c00-4824-9a2d-21880fe22399 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.169548 Feb 09 13:14:12.659118 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 241/468] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:12 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:13.111408 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-65648079-e6fd-4a76-872c-4f8ba4bf2729 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:13.112097 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-65648079-e6fd-4a76-872c-4f8ba4bf2729 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:13.118319 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-65648079-e6fd-4a76-872c-4f8ba4bf2729 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:13.118814 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-65648079-e6fd-4a76-872c-4f8ba4bf2729 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:13.120354 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-65648079-e6fd-4a76-872c-4f8ba4bf2729 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:13.120801 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-65648079-e6fd-4a76-872c-4f8ba4bf2729 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:13.203187 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-08b67cd3-3e1f-421e-90eb-7e573655ef3f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:13.203966 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-08b67cd3-3e1f-421e-90eb-7e573655ef3f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:13.210469 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-08b67cd3-3e1f-421e-90eb-7e573655ef3f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:13.211034 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-08b67cd3-3e1f-421e-90eb-7e573655ef3f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:13.211832 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-08b67cd3-3e1f-421e-90eb-7e573655ef3f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:13.212262 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-08b67cd3-3e1f-421e-90eb-7e573655ef3f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:13.279163 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-65648079-e6fd-4a76-872c-4f8ba4bf2729 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:13.287141 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-65648079-e6fd-4a76-872c-4f8ba4bf2729 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.179454 Feb 09 13:14:13.287908 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 228/469] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:13 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:13.349915 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-08b67cd3-3e1f-421e-90eb-7e573655ef3f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:13.363469 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-08b67cd3-3e1f-421e-90eb-7e573655ef3f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1318 microversion: 2.1 time: 0.163588 Feb 09 13:14:13.363934 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 242/470] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:13 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:13.675376 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-911c10a0-3703-4968-9413-bda732a9f7a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:13.675968 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-911c10a0-3703-4968-9413-bda732a9f7a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:13.682893 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-911c10a0-3703-4968-9413-bda732a9f7a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:13.683708 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-911c10a0-3703-4968-9413-bda732a9f7a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:13.684213 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-911c10a0-3703-4968-9413-bda732a9f7a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:13.684658 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-911c10a0-3703-4968-9413-bda732a9f7a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:13.889922 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-911c10a0-3703-4968-9413-bda732a9f7a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:13.898109 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-911c10a0-3703-4968-9413-bda732a9f7a4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.226749 Feb 09 13:14:13.898733 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 229/471] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:13 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:14.308620 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-4f3ed6bd-fc0f-4cd7-a8d1-c6aa306cbd52 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:14.309761 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-4f3ed6bd-fc0f-4cd7-a8d1-c6aa306cbd52 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:14.318882 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4f3ed6bd-fc0f-4cd7-a8d1-c6aa306cbd52 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:14.319341 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4f3ed6bd-fc0f-4cd7-a8d1-c6aa306cbd52 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:14.320156 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4f3ed6bd-fc0f-4cd7-a8d1-c6aa306cbd52 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:14.320596 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4f3ed6bd-fc0f-4cd7-a8d1-c6aa306cbd52 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:14.380528 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-11d0eaf6-5bac-4399-b439-6accf20cd854 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:14.381194 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-11d0eaf6-5bac-4399-b439-6accf20cd854 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:14.388422 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-11d0eaf6-5bac-4399-b439-6accf20cd854 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:14.388879 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-11d0eaf6-5bac-4399-b439-6accf20cd854 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:14.389685 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-11d0eaf6-5bac-4399-b439-6accf20cd854 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:14.390127 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-11d0eaf6-5bac-4399-b439-6accf20cd854 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:14.469606 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-4f3ed6bd-fc0f-4cd7-a8d1-c6aa306cbd52 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:14.484176 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-4f3ed6bd-fc0f-4cd7-a8d1-c6aa306cbd52 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1357 microversion: 2.1 time: 0.181262 Feb 09 13:14:14.485220 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 243/472] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:14 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:14.544570 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-11d0eaf6-5bac-4399-b439-6accf20cd854 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:14.556059 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-11d0eaf6-5bac-4399-b439-6accf20cd854 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1318 microversion: 2.1 time: 0.179408 Feb 09 13:14:14.556684 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 230/473] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:14 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:14.916022 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-9cf69ecd-7f37-4e4c-95fe-9ab1baa72d43 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:14.917156 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-9cf69ecd-7f37-4e4c-95fe-9ab1baa72d43 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:14.923395 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9cf69ecd-7f37-4e4c-95fe-9ab1baa72d43 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:14.923861 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9cf69ecd-7f37-4e4c-95fe-9ab1baa72d43 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:14.924659 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9cf69ecd-7f37-4e4c-95fe-9ab1baa72d43 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:14.925107 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9cf69ecd-7f37-4e4c-95fe-9ab1baa72d43 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:15.060003 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-9cf69ecd-7f37-4e4c-95fe-9ab1baa72d43 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:15.068015 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-9cf69ecd-7f37-4e4c-95fe-9ab1baa72d43 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.155982 Feb 09 13:14:15.068608 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 244/474] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:14 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:15.501139 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-f3b376ae-cfef-4fda-8cc8-eca11327aee2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:15.501746 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-f3b376ae-cfef-4fda-8cc8-eca11327aee2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:15.508096 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f3b376ae-cfef-4fda-8cc8-eca11327aee2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:15.508549 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f3b376ae-cfef-4fda-8cc8-eca11327aee2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:15.509382 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f3b376ae-cfef-4fda-8cc8-eca11327aee2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:15.510630 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f3b376ae-cfef-4fda-8cc8-eca11327aee2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:15.573285 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-9218ca02-c4b6-4a4b-9e3e-a9509f7660d1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:15.574928 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-9218ca02-c4b6-4a4b-9e3e-a9509f7660d1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:15.581855 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9218ca02-c4b6-4a4b-9e3e-a9509f7660d1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:15.582418 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9218ca02-c4b6-4a4b-9e3e-a9509f7660d1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:15.583591 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9218ca02-c4b6-4a4b-9e3e-a9509f7660d1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:15.584037 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9218ca02-c4b6-4a4b-9e3e-a9509f7660d1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:15.668717 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-f3b376ae-cfef-4fda-8cc8-eca11327aee2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:15.676784 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-f3b376ae-cfef-4fda-8cc8-eca11327aee2 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1548 microversion: 2.1 time: 0.178928 Feb 09 13:14:15.677262 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 231/475] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:15 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1548 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:15.698863 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-6a90bfc2-93f5-4989-b12d-308499f441d6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:15.699878 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-6a90bfc2-93f5-4989-b12d-308499f441d6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:15.706101 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6a90bfc2-93f5-4989-b12d-308499f441d6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:15.706580 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6a90bfc2-93f5-4989-b12d-308499f441d6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:15.707419 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6a90bfc2-93f5-4989-b12d-308499f441d6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:15.707877 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6a90bfc2-93f5-4989-b12d-308499f441d6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:15.736592 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-9218ca02-c4b6-4a4b-9e3e-a9509f7660d1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:15.744954 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-9218ca02-c4b6-4a4b-9e3e-a9509f7660d1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1318 microversion: 2.1 time: 0.175930 Feb 09 13:14:15.745531 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 245/476] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:15 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:15.856045 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6a90bfc2-93f5-4989-b12d-308499f441d6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:15.863701 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-6a90bfc2-93f5-4989-b12d-308499f441d6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1548 microversion: 2.1 time: 0.168428 Feb 09 13:14:15.864273 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 232/477] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:15 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:15.879627 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-bbfb6954-5586-4c2e-afc8-b5713ff0b3e5 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:15.883052 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:14:15.883052 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:14:15.884094 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-bbfb6954-5586-4c2e-afc8-b5713ff0b3e5 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:15.885353 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-bbfb6954-5586-4c2e-afc8-b5713ff0b3e5 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Searching by: {'deleted': False, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5'} {{(pid=116748) get_all /opt/stack/nova/nova/compute/api.py:2908}} Feb 09 13:14:15.892441 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bbfb6954-5586-4c2e-afc8-b5713ff0b3e5 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:15.900057 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bbfb6954-5586-4c2e-afc8-b5713ff0b3e5 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:15.900057 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bbfb6954-5586-4c2e-afc8-b5713ff0b3e5 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:15.900057 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bbfb6954-5586-4c2e-afc8-b5713ff0b3e5 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:15.986720 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.multi_cell_list [None req-bbfb6954-5586-4c2e-afc8-b5713ff0b3e5 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116748) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 09 13:14:16.084749 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8257560b-9183-491d-a7ef-826850bc703d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:16.085270 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8257560b-9183-491d-a7ef-826850bc703d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:16.091194 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8257560b-9183-491d-a7ef-826850bc703d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:16.091648 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8257560b-9183-491d-a7ef-826850bc703d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:16.092419 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8257560b-9183-491d-a7ef-826850bc703d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:16.092852 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8257560b-9183-491d-a7ef-826850bc703d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:16.096457 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-bbfb6954-5586-4c2e-afc8-b5713ff0b3e5 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.220794 Feb 09 13:14:16.097161 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 246/478] 10.222.0.84 () {58 vars in 1124 bytes} [Wed Feb 9 13:14:15 2022] GET /compute/v2.1/servers => generated 342 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:14:16.107188 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-00bd7bff-2ea0-4599-a725-c1011c9dfdfd tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:16.110030 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-00bd7bff-2ea0-4599-a725-c1011c9dfdfd tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:16.113728 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-00bd7bff-2ea0-4599-a725-c1011c9dfdfd tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:16.114181 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-00bd7bff-2ea0-4599-a725-c1011c9dfdfd tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:16.115013 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-00bd7bff-2ea0-4599-a725-c1011c9dfdfd tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:16.115452 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-00bd7bff-2ea0-4599-a725-c1011c9dfdfd tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:16.249652 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8257560b-9183-491d-a7ef-826850bc703d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:16.263624 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8257560b-9183-491d-a7ef-826850bc703d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.176430 Feb 09 13:14:16.263624 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 233/479] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:16 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:16.263846 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-00bd7bff-2ea0-4599-a725-c1011c9dfdfd tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:16.268475 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-00bd7bff-2ea0-4599-a725-c1011c9dfdfd tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1548 microversion: 2.1 time: 0.165262 Feb 09 13:14:16.269048 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 247/480] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:16 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:16.760994 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c26c2803-d5cc-4e7f-8286-55331ce8d3eb tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:16.761595 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-c26c2803-d5cc-4e7f-8286-55331ce8d3eb tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:16.767981 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c26c2803-d5cc-4e7f-8286-55331ce8d3eb tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:16.768422 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c26c2803-d5cc-4e7f-8286-55331ce8d3eb tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:16.769193 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c26c2803-d5cc-4e7f-8286-55331ce8d3eb tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:16.769841 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c26c2803-d5cc-4e7f-8286-55331ce8d3eb tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:16.905596 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c26c2803-d5cc-4e7f-8286-55331ce8d3eb tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:16.921678 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c26c2803-d5cc-4e7f-8286-55331ce8d3eb tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1508 microversion: 2.1 time: 0.155723 Feb 09 13:14:16.921678 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 234/481] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:16 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:17.278623 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d2e016df-03f6-48aa-b751-8914144bf3b2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:17.280236 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d2e016df-03f6-48aa-b751-8914144bf3b2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:17.292085 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d2e016df-03f6-48aa-b751-8914144bf3b2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:17.292803 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d2e016df-03f6-48aa-b751-8914144bf3b2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:17.293762 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d2e016df-03f6-48aa-b751-8914144bf3b2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:17.294268 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d2e016df-03f6-48aa-b751-8914144bf3b2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:17.439009 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d2e016df-03f6-48aa-b751-8914144bf3b2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:17.442010 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d2e016df-03f6-48aa-b751-8914144bf3b2 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.170610 Feb 09 13:14:17.442699 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 248/482] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:17 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:18.458696 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-76521a44-bd7b-467d-9653-bdfdc52364bc tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:18.459303 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-76521a44-bd7b-467d-9653-bdfdc52364bc tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:18.466000 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-76521a44-bd7b-467d-9653-bdfdc52364bc tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:18.466449 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-76521a44-bd7b-467d-9653-bdfdc52364bc tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:18.467252 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-76521a44-bd7b-467d-9653-bdfdc52364bc tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:18.467690 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-76521a44-bd7b-467d-9653-bdfdc52364bc tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:18.600303 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-76521a44-bd7b-467d-9653-bdfdc52364bc tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:18.608891 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-76521a44-bd7b-467d-9653-bdfdc52364bc tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.153799 Feb 09 13:14:18.609455 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 235/483] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:18 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:19.626005 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-1d775834-1206-40fe-942c-2946e196ddd4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:19.626740 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-1d775834-1206-40fe-942c-2946e196ddd4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:19.632979 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1d775834-1206-40fe-942c-2946e196ddd4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:19.633431 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1d775834-1206-40fe-942c-2946e196ddd4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:19.634215 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1d775834-1206-40fe-942c-2946e196ddd4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:19.634737 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1d775834-1206-40fe-942c-2946e196ddd4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:19.767776 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-1d775834-1206-40fe-942c-2946e196ddd4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:19.775599 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-1d775834-1206-40fe-942c-2946e196ddd4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.153455 Feb 09 13:14:19.776168 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 249/484] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:19 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:20.791652 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-cd9deb55-8c8d-4813-b2aa-6d43e15c4e79 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:20.792363 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-cd9deb55-8c8d-4813-b2aa-6d43e15c4e79 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:20.798729 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-cd9deb55-8c8d-4813-b2aa-6d43e15c4e79 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:20.799307 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-cd9deb55-8c8d-4813-b2aa-6d43e15c4e79 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:20.800195 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-cd9deb55-8c8d-4813-b2aa-6d43e15c4e79 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:20.800639 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-cd9deb55-8c8d-4813-b2aa-6d43e15c4e79 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:20.937888 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-cd9deb55-8c8d-4813-b2aa-6d43e15c4e79 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:20.945922 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-cd9deb55-8c8d-4813-b2aa-6d43e15c4e79 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.157929 Feb 09 13:14:20.946484 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 236/485] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:20 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:21.348769 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-40fe5092-73b8-4647-be79-4e5126230345 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c3b8eb9-9eb3-44e6-a942-06aa8611f155"}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:14:21.349901 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-40fe5092-73b8-4647-be79-4e5126230345 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:21.358271 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-40fe5092-73b8-4647-be79-4e5126230345 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:21.358766 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-40fe5092-73b8-4647-be79-4e5126230345 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:21.359559 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-40fe5092-73b8-4647-be79-4e5126230345 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:21.359992 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-40fe5092-73b8-4647-be79-4e5126230345 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:21.686292 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-dc0ee183-8e20-417e-b8f1-e84a46db5f33 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd7119c2-6ecb-449d-a6f3-e56d748ec18f"}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:14:21.687453 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-dc0ee183-8e20-417e-b8f1-e84a46db5f33 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:21.693980 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-dc0ee183-8e20-417e-b8f1-e84a46db5f33 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:21.694754 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-dc0ee183-8e20-417e-b8f1-e84a46db5f33 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:21.695569 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-dc0ee183-8e20-417e-b8f1-e84a46db5f33 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:21.696016 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-dc0ee183-8e20-417e-b8f1-e84a46db5f33 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:22.158982 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-40fe5092-73b8-4647-be79-4e5126230345 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "POST /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.813592 Feb 09 13:14:22.159704 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 250/486] 10.222.0.84 () {60 vars in 1322 bytes} [Wed Feb 9 13:14:21 2022] POST /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618/os-volume_attachments => generated 194 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:14:22.164715 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-28c79ac9-a841-4173-8642-c858a0fd6c80 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:22.165531 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-28c79ac9-a841-4173-8642-c858a0fd6c80 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:22.173946 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-28c79ac9-a841-4173-8642-c858a0fd6c80 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:22.174515 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-28c79ac9-a841-4173-8642-c858a0fd6c80 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:22.175756 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-28c79ac9-a841-4173-8642-c858a0fd6c80 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:22.176215 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-28c79ac9-a841-4173-8642-c858a0fd6c80 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:22.324560 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-28c79ac9-a841-4173-8642-c858a0fd6c80 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:22.332328 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-28c79ac9-a841-4173-8642-c858a0fd6c80 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.171399 Feb 09 13:14:22.333569 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 251/487] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:22 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:22.589023 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-dc0ee183-8e20-417e-b8f1-e84a46db5f33 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "POST /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.905415 Feb 09 13:14:22.589825 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 237/488] 10.222.0.84 () {60 vars in 1322 bytes} [Wed Feb 9 13:14:21 2022] POST /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb/os-volume_attachments => generated 194 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:14:23.349346 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-82b0fb1e-22d1-4331-95a6-2df803c64e6f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:23.349967 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-82b0fb1e-22d1-4331-95a6-2df803c64e6f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:23.356395 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-82b0fb1e-22d1-4331-95a6-2df803c64e6f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:23.356852 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-82b0fb1e-22d1-4331-95a6-2df803c64e6f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:23.357675 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-82b0fb1e-22d1-4331-95a6-2df803c64e6f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:23.358116 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-82b0fb1e-22d1-4331-95a6-2df803c64e6f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:23.497375 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-82b0fb1e-22d1-4331-95a6-2df803c64e6f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:23.512019 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-82b0fb1e-22d1-4331-95a6-2df803c64e6f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.166586 Feb 09 13:14:23.512863 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 252/489] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:23 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:23.751464 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-9f9c14eb-5a80-43ac-adba-52f02355923c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:14:23.752131 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-9f9c14eb-5a80-43ac-adba-52f02355923c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:23.758690 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9f9c14eb-5a80-43ac-adba-52f02355923c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:23.759145 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9f9c14eb-5a80-43ac-adba-52f02355923c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:23.760303 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9f9c14eb-5a80-43ac-adba-52f02355923c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:23.760747 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9f9c14eb-5a80-43ac-adba-52f02355923c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:23.784731 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.objects.instance [None req-9f9c14eb-5a80-43ac-adba-52f02355923c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lazy-loading 'flavor' on Instance uuid 267a95df-7ddb-4e9c-a629-4fc26b9c9843 {{(pid=116749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:14:24.309904 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-9f9c14eb-5a80-43ac-adba-52f02355923c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "POST /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843/action" status: 202 len: 0 microversion: 2.20 time: 0.560996 Feb 09 13:14:24.309904 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 238/490] 10.222.0.84 () {62 vars in 1318 bytes} [Wed Feb 9 13:14:23 2022] POST /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843/action => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 09 13:14:24.317712 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-946a52f1-2732-4f5f-97cd-2f9b6c1654e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:24.318411 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-946a52f1-2732-4f5f-97cd-2f9b6c1654e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:24.324571 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-946a52f1-2732-4f5f-97cd-2f9b6c1654e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:24.325104 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-946a52f1-2732-4f5f-97cd-2f9b6c1654e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:24.325992 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-946a52f1-2732-4f5f-97cd-2f9b6c1654e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:24.326498 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-946a52f1-2732-4f5f-97cd-2f9b6c1654e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:24.463826 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-946a52f1-2732-4f5f-97cd-2f9b6c1654e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:24.472678 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-946a52f1-2732-4f5f-97cd-2f9b6c1654e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:24.474285 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-946a52f1-2732-4f5f-97cd-2f9b6c1654e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:24.475628 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-946a52f1-2732-4f5f-97cd-2f9b6c1654e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1721 microversion: 2.20 time: 0.161577 Feb 09 13:14:24.479119 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 253/491] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:24 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:24.531720 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-33f475fb-f6bc-4c51-b8da-9000729390ba tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:24.532407 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-33f475fb-f6bc-4c51-b8da-9000729390ba tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:24.538531 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-33f475fb-f6bc-4c51-b8da-9000729390ba tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:24.539006 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-33f475fb-f6bc-4c51-b8da-9000729390ba tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:24.539777 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-33f475fb-f6bc-4c51-b8da-9000729390ba tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:24.540206 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-33f475fb-f6bc-4c51-b8da-9000729390ba tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:24.676289 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-33f475fb-f6bc-4c51-b8da-9000729390ba tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:24.684094 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-33f475fb-f6bc-4c51-b8da-9000729390ba tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.156335 Feb 09 13:14:24.684673 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 239/492] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:24 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:25.496053 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-75081ba2-7a12-496d-9262-8dbd0c9cfc6b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:25.496663 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-75081ba2-7a12-496d-9262-8dbd0c9cfc6b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:25.502909 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-75081ba2-7a12-496d-9262-8dbd0c9cfc6b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:25.503366 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-75081ba2-7a12-496d-9262-8dbd0c9cfc6b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:25.504150 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-75081ba2-7a12-496d-9262-8dbd0c9cfc6b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:25.504592 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-75081ba2-7a12-496d-9262-8dbd0c9cfc6b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:25.643544 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-75081ba2-7a12-496d-9262-8dbd0c9cfc6b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:25.652146 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-75081ba2-7a12-496d-9262-8dbd0c9cfc6b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:25.653801 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-75081ba2-7a12-496d-9262-8dbd0c9cfc6b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:25.658590 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-75081ba2-7a12-496d-9262-8dbd0c9cfc6b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1721 microversion: 2.20 time: 0.163326 Feb 09 13:14:25.658590 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 254/493] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:25 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:25.700870 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-0cfe9504-88e1-44f3-a750-67763a4f9339 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:25.701475 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-0cfe9504-88e1-44f3-a750-67763a4f9339 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:25.709156 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0cfe9504-88e1-44f3-a750-67763a4f9339 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:25.709665 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0cfe9504-88e1-44f3-a750-67763a4f9339 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:25.710819 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0cfe9504-88e1-44f3-a750-67763a4f9339 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:25.711361 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0cfe9504-88e1-44f3-a750-67763a4f9339 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:25.847759 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-0cfe9504-88e1-44f3-a750-67763a4f9339 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:25.856154 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-0cfe9504-88e1-44f3-a750-67763a4f9339 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.158978 Feb 09 13:14:25.856728 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 240/494] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:25 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:26.675329 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-ea60246c-f8f8-449f-a130-6cd6b9b97612 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:26.675940 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-ea60246c-f8f8-449f-a130-6cd6b9b97612 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:26.683606 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ea60246c-f8f8-449f-a130-6cd6b9b97612 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:26.684060 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ea60246c-f8f8-449f-a130-6cd6b9b97612 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:26.684852 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ea60246c-f8f8-449f-a130-6cd6b9b97612 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:26.685747 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ea60246c-f8f8-449f-a130-6cd6b9b97612 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:26.856087 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ea60246c-f8f8-449f-a130-6cd6b9b97612 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:26.864129 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ea60246c-f8f8-449f-a130-6cd6b9b97612 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:26.865650 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ea60246c-f8f8-449f-a130-6cd6b9b97612 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:26.866965 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-ea60246c-f8f8-449f-a130-6cd6b9b97612 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1721 microversion: 2.20 time: 0.195633 Feb 09 13:14:26.876331 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 255/495] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:26 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:26.876605 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8c30da31-7ed9-4631-83e2-1c485a5f3f69 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:26.876605 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8c30da31-7ed9-4631-83e2-1c485a5f3f69 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:26.880324 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8c30da31-7ed9-4631-83e2-1c485a5f3f69 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:26.880813 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8c30da31-7ed9-4631-83e2-1c485a5f3f69 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:26.881616 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8c30da31-7ed9-4631-83e2-1c485a5f3f69 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:26.882061 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8c30da31-7ed9-4631-83e2-1c485a5f3f69 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:27.087790 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8c30da31-7ed9-4631-83e2-1c485a5f3f69 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:27.095534 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8c30da31-7ed9-4631-83e2-1c485a5f3f69 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.226569 Feb 09 13:14:27.096121 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 241/496] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:26 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:27.885092 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-e054c86b-8287-425e-acde-31ccbce539e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:27.885643 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-e054c86b-8287-425e-acde-31ccbce539e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:27.891917 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e054c86b-8287-425e-acde-31ccbce539e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:27.892391 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e054c86b-8287-425e-acde-31ccbce539e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:27.893162 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e054c86b-8287-425e-acde-31ccbce539e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:27.893604 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e054c86b-8287-425e-acde-31ccbce539e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:28.034274 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e054c86b-8287-425e-acde-31ccbce539e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:28.042811 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e054c86b-8287-425e-acde-31ccbce539e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:28.044319 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e054c86b-8287-425e-acde-31ccbce539e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:28.045505 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-e054c86b-8287-425e-acde-31ccbce539e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1721 microversion: 2.20 time: 0.164224 Feb 09 13:14:28.046028 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 256/497] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:27 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:28.112822 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-38ea7e33-31a0-4f34-88d7-7b138bf7f486 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:28.113430 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-38ea7e33-31a0-4f34-88d7-7b138bf7f486 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:28.120496 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-38ea7e33-31a0-4f34-88d7-7b138bf7f486 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:28.120944 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-38ea7e33-31a0-4f34-88d7-7b138bf7f486 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:28.121778 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-38ea7e33-31a0-4f34-88d7-7b138bf7f486 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:28.122220 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-38ea7e33-31a0-4f34-88d7-7b138bf7f486 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:28.277463 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-38ea7e33-31a0-4f34-88d7-7b138bf7f486 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:28.291660 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-38ea7e33-31a0-4f34-88d7-7b138bf7f486 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.176564 Feb 09 13:14:28.291660 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 242/498] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:28 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:29.063964 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-39022a92-8d9e-4ecc-88f7-4dbf16ce093e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:29.064656 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-39022a92-8d9e-4ecc-88f7-4dbf16ce093e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:29.071140 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-39022a92-8d9e-4ecc-88f7-4dbf16ce093e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:29.071599 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-39022a92-8d9e-4ecc-88f7-4dbf16ce093e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:29.073018 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-39022a92-8d9e-4ecc-88f7-4dbf16ce093e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:29.073487 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-39022a92-8d9e-4ecc-88f7-4dbf16ce093e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:29.216488 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-39022a92-8d9e-4ecc-88f7-4dbf16ce093e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:29.224698 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-39022a92-8d9e-4ecc-88f7-4dbf16ce093e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:29.226198 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-39022a92-8d9e-4ecc-88f7-4dbf16ce093e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:29.227369 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-39022a92-8d9e-4ecc-88f7-4dbf16ce093e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1721 microversion: 2.20 time: 0.167337 Feb 09 13:14:29.227933 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 257/499] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:29 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:29.303400 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-0b741964-36c7-4eb6-a72f-41306bae8e5b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:29.304020 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-0b741964-36c7-4eb6-a72f-41306bae8e5b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:29.311303 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0b741964-36c7-4eb6-a72f-41306bae8e5b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:29.311752 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0b741964-36c7-4eb6-a72f-41306bae8e5b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:29.312570 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0b741964-36c7-4eb6-a72f-41306bae8e5b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:29.313016 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0b741964-36c7-4eb6-a72f-41306bae8e5b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:29.480351 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-0b741964-36c7-4eb6-a72f-41306bae8e5b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:29.485331 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-0b741964-36c7-4eb6-a72f-41306bae8e5b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.186504 Feb 09 13:14:29.485921 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 243/500] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:29 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:30.245418 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-6a22e5e2-95b6-4692-8589-a2fe80dbe20b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:30.246211 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-6a22e5e2-95b6-4692-8589-a2fe80dbe20b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:30.252799 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6a22e5e2-95b6-4692-8589-a2fe80dbe20b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:30.253943 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6a22e5e2-95b6-4692-8589-a2fe80dbe20b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:30.254982 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6a22e5e2-95b6-4692-8589-a2fe80dbe20b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:30.255535 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6a22e5e2-95b6-4692-8589-a2fe80dbe20b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:30.432780 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6a22e5e2-95b6-4692-8589-a2fe80dbe20b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:30.440643 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6a22e5e2-95b6-4692-8589-a2fe80dbe20b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:30.442147 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6a22e5e2-95b6-4692-8589-a2fe80dbe20b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:30.443561 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-6a22e5e2-95b6-4692-8589-a2fe80dbe20b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1721 microversion: 2.20 time: 0.201981 Feb 09 13:14:30.444121 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 258/501] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:30 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:30.503033 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-6dbc08fc-a74e-4857-afd9-05189fdda589 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:30.503574 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-6dbc08fc-a74e-4857-afd9-05189fdda589 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:30.510449 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6dbc08fc-a74e-4857-afd9-05189fdda589 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:30.510927 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6dbc08fc-a74e-4857-afd9-05189fdda589 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:30.511724 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6dbc08fc-a74e-4857-afd9-05189fdda589 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:30.512257 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6dbc08fc-a74e-4857-afd9-05189fdda589 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:30.648693 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6dbc08fc-a74e-4857-afd9-05189fdda589 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:30.657814 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-6dbc08fc-a74e-4857-afd9-05189fdda589 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.158617 Feb 09 13:14:30.658374 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 244/502] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:30 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:30.832549 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-e9fadca1-13e9-4e85-9e42-fb18bd51f685 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:30.833169 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-e9fadca1-13e9-4e85-9e42-fb18bd51f685 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:30.839712 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e9fadca1-13e9-4e85-9e42-fb18bd51f685 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:30.840163 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e9fadca1-13e9-4e85-9e42-fb18bd51f685 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:30.840952 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e9fadca1-13e9-4e85-9e42-fb18bd51f685 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:30.841392 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e9fadca1-13e9-4e85-9e42-fb18bd51f685 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:30.975370 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e9fadca1-13e9-4e85-9e42-fb18bd51f685 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:30.983478 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-e9fadca1-13e9-4e85-9e42-fb18bd51f685 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1594 microversion: 2.1 time: 0.154690 Feb 09 13:14:30.984253 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 259/503] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:30 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:31.462022 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-cff2c50d-de5a-45c4-869f-547f71f9c299 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:31.462682 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-cff2c50d-de5a-45c4-869f-547f71f9c299 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:31.468754 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-cff2c50d-de5a-45c4-869f-547f71f9c299 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:31.469012 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-cff2c50d-de5a-45c4-869f-547f71f9c299 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:31.469885 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-cff2c50d-de5a-45c4-869f-547f71f9c299 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:31.470329 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-cff2c50d-de5a-45c4-869f-547f71f9c299 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:31.611065 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-cff2c50d-de5a-45c4-869f-547f71f9c299 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:31.620208 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-cff2c50d-de5a-45c4-869f-547f71f9c299 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:31.623672 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-cff2c50d-de5a-45c4-869f-547f71f9c299 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:31.623672 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-cff2c50d-de5a-45c4-869f-547f71f9c299 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1721 microversion: 2.20 time: 0.164633 Feb 09 13:14:31.623672 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 245/504] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:31 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:31.676823 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-b6845354-63cd-4949-b2e9-2b1dcb9ee6c9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:31.677476 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-b6845354-63cd-4949-b2e9-2b1dcb9ee6c9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:31.686842 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b6845354-63cd-4949-b2e9-2b1dcb9ee6c9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:31.686842 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b6845354-63cd-4949-b2e9-2b1dcb9ee6c9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:31.689661 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b6845354-63cd-4949-b2e9-2b1dcb9ee6c9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:31.689661 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b6845354-63cd-4949-b2e9-2b1dcb9ee6c9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:31.961606 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-b6845354-63cd-4949-b2e9-2b1dcb9ee6c9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:31.970242 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-b6845354-63cd-4949-b2e9-2b1dcb9ee6c9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1566 microversion: 2.1 time: 0.298256 Feb 09 13:14:31.970948 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 260/505] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:31 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1566 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:32.641174 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-bd3717a1-57e9-40f5-86ec-e15031eca636 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:32.642018 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-bd3717a1-57e9-40f5-86ec-e15031eca636 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:32.648334 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bd3717a1-57e9-40f5-86ec-e15031eca636 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:32.648785 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bd3717a1-57e9-40f5-86ec-e15031eca636 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:32.649580 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bd3717a1-57e9-40f5-86ec-e15031eca636 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:32.650321 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bd3717a1-57e9-40f5-86ec-e15031eca636 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:32.804626 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-bd3717a1-57e9-40f5-86ec-e15031eca636 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:32.815276 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-bd3717a1-57e9-40f5-86ec-e15031eca636 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:32.817386 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-bd3717a1-57e9-40f5-86ec-e15031eca636 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:32.818601 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-bd3717a1-57e9-40f5-86ec-e15031eca636 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1721 microversion: 2.20 time: 0.181190 Feb 09 13:14:32.819169 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 246/506] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:32 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:32.987748 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-aad8ff04-c8ea-4a64-95ea-9d355f00f610 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:32.988720 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-aad8ff04-c8ea-4a64-95ea-9d355f00f610 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:32.996021 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-aad8ff04-c8ea-4a64-95ea-9d355f00f610 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:32.996478 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-aad8ff04-c8ea-4a64-95ea-9d355f00f610 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:32.997354 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-aad8ff04-c8ea-4a64-95ea-9d355f00f610 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:32.997849 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-aad8ff04-c8ea-4a64-95ea-9d355f00f610 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:33.237847 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-aad8ff04-c8ea-4a64-95ea-9d355f00f610 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:33.246697 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-aad8ff04-c8ea-4a64-95ea-9d355f00f610 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1546 microversion: 2.1 time: 0.262688 Feb 09 13:14:33.247276 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 261/507] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:32 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1546 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:33.265376 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-b6250c69-913d-44fc-bf9a-ebe0f13fdb4f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:33.266080 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-b6250c69-913d-44fc-bf9a-ebe0f13fdb4f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:33.272164 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b6250c69-913d-44fc-bf9a-ebe0f13fdb4f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:33.272621 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b6250c69-913d-44fc-bf9a-ebe0f13fdb4f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:33.273598 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b6250c69-913d-44fc-bf9a-ebe0f13fdb4f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:33.274039 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b6250c69-913d-44fc-bf9a-ebe0f13fdb4f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:33.370771 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-b6250c69-913d-44fc-bf9a-ebe0f13fdb4f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] HTTP exception thrown: Cannot 'detach_volume' instance 6851d5fe-b010-49cc-8696-19a1008c2beb while it is in vm_state rescued Feb 09 13:14:33.371345 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-b6250c69-913d-44fc-bf9a-ebe0f13fdb4f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Returning 409 to user: Cannot 'detach_volume' instance 6851d5fe-b010-49cc-8696-19a1008c2beb while it is in vm_state rescued {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:14:33.372182 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-b6250c69-913d-44fc-bf9a-ebe0f13fdb4f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "DELETE /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/os-volume_attachments/facb3b3e-fda6-4c94-96d6-e2b44bb5793f" status: 409 len: 152 microversion: 2.1 time: 0.112607 Feb 09 13:14:33.372737 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 247/508] 10.222.0.84 () {58 vars in 1415 bytes} [Wed Feb 9 13:14:33 2022] DELETE /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/os-volume_attachments/facb3b3e-fda6-4c94-96d6-e2b44bb5793f => generated 152 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 09 13:14:33.380984 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-c5e1fa90-6070-4c5d-8f31-e2e3a59e29ee tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:14:33.381508 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-c5e1fa90-6070-4c5d-8f31-e2e3a59e29ee tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:33.388075 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c5e1fa90-6070-4c5d-8f31-e2e3a59e29ee tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:33.388787 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c5e1fa90-6070-4c5d-8f31-e2e3a59e29ee tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:33.389786 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c5e1fa90-6070-4c5d-8f31-e2e3a59e29ee tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:33.390455 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c5e1fa90-6070-4c5d-8f31-e2e3a59e29ee tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:33.511078 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-fcd9ea31-a9ba-465a-8ce4-21412553015e req-372ccc62-b780-4d61-8d1e-a25dc77cdab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982d841e-c5c6-44a9-9982-44f8cc31b618", "tag": "aa6d2832-0830-44ab-bdba-ad1e71f0308b"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:14:33.512774 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:14:33.512774 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:14:33.520893 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-fcd9ea31-a9ba-465a-8ce4-21412553015e req-372ccc62-b780-4d61-8d1e-a25dc77cdab5 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:33.521335 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-fcd9ea31-a9ba-465a-8ce4-21412553015e req-372ccc62-b780-4d61-8d1e-a25dc77cdab5 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:33.533218 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-fcd9ea31-a9ba-465a-8ce4-21412553015e req-372ccc62-b780-4d61-8d1e-a25dc77cdab5 service nova] Creating event network-changed:aa6d2832-0830-44ab-bdba-ad1e71f0308b for instance 982d841e-c5c6-44a9-9982-44f8cc31b618 on hv-cinder-82786 Feb 09 13:14:33.538414 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-fcd9ea31-a9ba-465a-8ce4-21412553015e req-372ccc62-b780-4d61-8d1e-a25dc77cdab5 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031941 Feb 09 13:14:33.539224 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 248/509] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:14:33.656490 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-c5e1fa90-6070-4c5d-8f31-e2e3a59e29ee tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "POST /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/action" status: 202 len: 0 microversion: 2.1 time: 0.278268 Feb 09 13:14:33.661358 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 262/510] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Feb 9 13:14:33 2022] POST /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:14:33.667093 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-25025d50-5719-4ccd-96dc-17b4d99eb824 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:33.668380 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-25025d50-5719-4ccd-96dc-17b4d99eb824 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:33.683548 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-25025d50-5719-4ccd-96dc-17b4d99eb824 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:33.684303 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-25025d50-5719-4ccd-96dc-17b4d99eb824 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:33.685283 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-25025d50-5719-4ccd-96dc-17b4d99eb824 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:33.685884 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-25025d50-5719-4ccd-96dc-17b4d99eb824 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:33.837712 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-4e568cd6-5637-4401-8f42-85bb7267dddc tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:33.838677 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-4e568cd6-5637-4401-8f42-85bb7267dddc tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:33.845577 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4e568cd6-5637-4401-8f42-85bb7267dddc tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:33.846267 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4e568cd6-5637-4401-8f42-85bb7267dddc tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:33.847102 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4e568cd6-5637-4401-8f42-85bb7267dddc tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:33.847541 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4e568cd6-5637-4401-8f42-85bb7267dddc tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:34.014467 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-4e568cd6-5637-4401-8f42-85bb7267dddc tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:34.027630 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-4e568cd6-5637-4401-8f42-85bb7267dddc tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:34.036405 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-4e568cd6-5637-4401-8f42-85bb7267dddc tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:34.038301 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-4e568cd6-5637-4401-8f42-85bb7267dddc tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1721 microversion: 2.20 time: 0.204098 Feb 09 13:14:34.049853 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 263/511] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:33 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:14:34.330721 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-25025d50-5719-4ccd-96dc-17b4d99eb824 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:34.347378 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-25025d50-5719-4ccd-96dc-17b4d99eb824 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1554 microversion: 2.1 time: 0.685057 Feb 09 13:14:34.348625 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 249/512] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:33 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1554 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:35.061082 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d7e07046-03d2-4a83-9eb4-9cdb1026b0bb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:35.061683 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d7e07046-03d2-4a83-9eb4-9cdb1026b0bb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:35.068042 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d7e07046-03d2-4a83-9eb4-9cdb1026b0bb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:35.068490 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d7e07046-03d2-4a83-9eb4-9cdb1026b0bb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:35.069276 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d7e07046-03d2-4a83-9eb4-9cdb1026b0bb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:35.069714 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d7e07046-03d2-4a83-9eb4-9cdb1026b0bb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:35.243456 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d7e07046-03d2-4a83-9eb4-9cdb1026b0bb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:35.251670 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d7e07046-03d2-4a83-9eb4-9cdb1026b0bb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:35.253205 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d7e07046-03d2-4a83-9eb4-9cdb1026b0bb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:35.254395 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d7e07046-03d2-4a83-9eb4-9cdb1026b0bb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1721 microversion: 2.20 time: 0.196997 Feb 09 13:14:35.254999 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 264/513] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:35 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:35.365558 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-65143923-25c3-4abb-9924-4e371ea2ae4c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:35.366805 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-65143923-25c3-4abb-9924-4e371ea2ae4c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:35.374420 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-65143923-25c3-4abb-9924-4e371ea2ae4c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:35.375238 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-65143923-25c3-4abb-9924-4e371ea2ae4c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:35.376042 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-65143923-25c3-4abb-9924-4e371ea2ae4c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:35.377133 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-65143923-25c3-4abb-9924-4e371ea2ae4c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:35.536672 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-65143923-25c3-4abb-9924-4e371ea2ae4c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:35.544924 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-65143923-25c3-4abb-9924-4e371ea2ae4c tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1554 microversion: 2.1 time: 0.183022 Feb 09 13:14:35.545523 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 250/514] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:35 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:36.273603 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-c70f5d98-8ffe-46da-8932-df0beba55899 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:36.273603 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-c70f5d98-8ffe-46da-8932-df0beba55899 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:36.280719 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c70f5d98-8ffe-46da-8932-df0beba55899 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:36.280719 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c70f5d98-8ffe-46da-8932-df0beba55899 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:36.281227 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c70f5d98-8ffe-46da-8932-df0beba55899 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:36.281668 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c70f5d98-8ffe-46da-8932-df0beba55899 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:36.438934 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-c70f5d98-8ffe-46da-8932-df0beba55899 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:36.463587 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-c70f5d98-8ffe-46da-8932-df0beba55899 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:36.467091 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-c70f5d98-8ffe-46da-8932-df0beba55899 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:36.468320 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-c70f5d98-8ffe-46da-8932-df0beba55899 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1721 microversion: 2.20 time: 0.200465 Feb 09 13:14:36.479421 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 265/515] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:36 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:36.563119 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-9b00ecde-5227-413e-9108-d52100f0a690 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:36.563839 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-9b00ecde-5227-413e-9108-d52100f0a690 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:36.569961 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9b00ecde-5227-413e-9108-d52100f0a690 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:36.570391 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9b00ecde-5227-413e-9108-d52100f0a690 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:36.571251 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9b00ecde-5227-413e-9108-d52100f0a690 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:36.571693 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9b00ecde-5227-413e-9108-d52100f0a690 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:36.684057 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-222bac64-37d1-4726-b038-4c91af8b9049 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2014828370"}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:14:36.684588 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-222bac64-37d1-4726-b038-4c91af8b9049 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:36.690314 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-222bac64-37d1-4726-b038-4c91af8b9049 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:36.690798 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-222bac64-37d1-4726-b038-4c91af8b9049 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:36.691942 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-222bac64-37d1-4726-b038-4c91af8b9049 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:36.692050 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-222bac64-37d1-4726-b038-4c91af8b9049 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:36.714027 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-9b00ecde-5227-413e-9108-d52100f0a690 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:36.730024 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-9b00ecde-5227-413e-9108-d52100f0a690 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1554 microversion: 2.1 time: 0.170990 Feb 09 13:14:36.730827 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 251/516] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:36 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:36.844488 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.network.security_group_api [None req-222bac64-37d1-4726-b038-4c91af8b9049 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Adding security group a0eb802f-205e-47fe-8ac4-b59f1049a4ae to port aa6d2832-0830-44ab-bdba-ad1e71f0308b Feb 09 13:14:37.321159 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-222bac64-37d1-4726-b038-4c91af8b9049 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "POST /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618/action" status: 202 len: 0 microversion: 2.1 time: 0.640711 Feb 09 13:14:37.323406 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 266/517] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Feb 9 13:14:36 2022] POST /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618/action => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 09 13:14:37.331786 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-10fc86bf-d7c3-484f-975b-2969c0a9165b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:37.332638 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-10fc86bf-d7c3-484f-975b-2969c0a9165b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:37.335604 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-d0d9de20-2fbe-4b8e-b387-ba1418bb9f87 req-606f01fc-dd60-497e-b8ca-35f4c4b16b8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982d841e-c5c6-44a9-9982-44f8cc31b618", "tag": "aa6d2832-0830-44ab-bdba-ad1e71f0308b"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:14:37.337307 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:14:37.337307 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:14:37.339058 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-10fc86bf-d7c3-484f-975b-2969c0a9165b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:37.339511 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-10fc86bf-d7c3-484f-975b-2969c0a9165b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:37.340352 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-10fc86bf-d7c3-484f-975b-2969c0a9165b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:37.340788 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-10fc86bf-d7c3-484f-975b-2969c0a9165b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:37.345697 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-d0d9de20-2fbe-4b8e-b387-ba1418bb9f87 req-606f01fc-dd60-497e-b8ca-35f4c4b16b8b service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:37.346448 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-d0d9de20-2fbe-4b8e-b387-ba1418bb9f87 req-606f01fc-dd60-497e-b8ca-35f4c4b16b8b service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:37.359232 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-d0d9de20-2fbe-4b8e-b387-ba1418bb9f87 req-606f01fc-dd60-497e-b8ca-35f4c4b16b8b service nova] Creating event network-changed:aa6d2832-0830-44ab-bdba-ad1e71f0308b for instance 982d841e-c5c6-44a9-9982-44f8cc31b618 on hv-cinder-82786 Feb 09 13:14:37.364921 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-d0d9de20-2fbe-4b8e-b387-ba1418bb9f87 req-606f01fc-dd60-497e-b8ca-35f4c4b16b8b service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032855 Feb 09 13:14:37.365758 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 267/518] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:14:37.493092 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-bf53c0f0-3755-45c4-ba7d-e74293f2016a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:37.493973 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-bf53c0f0-3755-45c4-ba7d-e74293f2016a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:37.523669 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bf53c0f0-3755-45c4-ba7d-e74293f2016a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:37.526569 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bf53c0f0-3755-45c4-ba7d-e74293f2016a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:37.527658 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bf53c0f0-3755-45c4-ba7d-e74293f2016a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:37.531870 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bf53c0f0-3755-45c4-ba7d-e74293f2016a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:37.693858 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-10fc86bf-d7c3-484f-975b-2969c0a9165b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:37.702142 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-10fc86bf-d7c3-484f-975b-2969c0a9165b tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1758 microversion: 2.1 time: 0.374418 Feb 09 13:14:37.705852 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 252/519] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:37 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1758 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:37.750850 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-7d48900e-2c89-4d95-a07f-994438e3cbb3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:37.752203 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-7d48900e-2c89-4d95-a07f-994438e3cbb3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:37.760877 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7d48900e-2c89-4d95-a07f-994438e3cbb3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:37.761741 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7d48900e-2c89-4d95-a07f-994438e3cbb3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:37.763028 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7d48900e-2c89-4d95-a07f-994438e3cbb3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:37.763760 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7d48900e-2c89-4d95-a07f-994438e3cbb3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:37.800603 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-bf53c0f0-3755-45c4-ba7d-e74293f2016a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:37.814802 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-bf53c0f0-3755-45c4-ba7d-e74293f2016a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:37.816469 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-bf53c0f0-3755-45c4-ba7d-e74293f2016a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:37.817703 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-bf53c0f0-3755-45c4-ba7d-e74293f2016a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1721 microversion: 2.20 time: 0.333919 Feb 09 13:14:37.819544 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 268/520] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:37 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1721 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:38.037340 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-7d48900e-2c89-4d95-a07f-994438e3cbb3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:38.059209 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-7d48900e-2c89-4d95-a07f-994438e3cbb3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1554 microversion: 2.1 time: 0.315082 Feb 09 13:14:38.067414 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 253/521] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:37 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1554 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:38.820279 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-cba49cfc-49f6-4fdc-944a-5bada765172f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:38.820819 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-cba49cfc-49f6-4fdc-944a-5bada765172f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:38.827014 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cba49cfc-49f6-4fdc-944a-5bada765172f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:38.827463 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cba49cfc-49f6-4fdc-944a-5bada765172f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:38.829009 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cba49cfc-49f6-4fdc-944a-5bada765172f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:38.829009 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cba49cfc-49f6-4fdc-944a-5bada765172f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:38.835515 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-f653c940-b053-43cc-b092-f6fd0d508a0e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:38.836119 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-f653c940-b053-43cc-b092-f6fd0d508a0e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:38.843901 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f653c940-b053-43cc-b092-f6fd0d508a0e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:38.846350 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f653c940-b053-43cc-b092-f6fd0d508a0e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:38.846350 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f653c940-b053-43cc-b092-f6fd0d508a0e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:38.846350 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f653c940-b053-43cc-b092-f6fd0d508a0e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:38.922045 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-cba49cfc-49f6-4fdc-944a-5bada765172f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lazy-loading 'services' on Instance uuid bed41059-48cc-4ddb-9a00-62f0c71f7dcb {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:14:39.016131 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-f653c940-b053-43cc-b092-f6fd0d508a0e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:39.024446 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-f653c940-b053-43cc-b092-f6fd0d508a0e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:39.026614 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-f653c940-b053-43cc-b092-f6fd0d508a0e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:39.027760 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-f653c940-b053-43cc-b092-f6fd0d508a0e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1721 microversion: 2.20 time: 0.195871 Feb 09 13:14:39.028318 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 254/522] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:38 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:39.077526 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-84ce3caf-a63e-4381-998b-a3e45def279d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:39.078139 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-84ce3caf-a63e-4381-998b-a3e45def279d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:39.084512 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-84ce3caf-a63e-4381-998b-a3e45def279d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:39.085062 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-84ce3caf-a63e-4381-998b-a3e45def279d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:39.085854 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-84ce3caf-a63e-4381-998b-a3e45def279d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:39.086305 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-84ce3caf-a63e-4381-998b-a3e45def279d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:39.126308 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-cba49cfc-49f6-4fdc-944a-5bada765172f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "DELETE /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb/os-volume_attachments/dd7119c2-6ecb-449d-a6f3-e56d748ec18f" status: 202 len: 0 microversion: 2.1 time: 0.309167 Feb 09 13:14:39.127396 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 269/523] 10.222.0.84 () {58 vars in 1415 bytes} [Wed Feb 9 13:14:38 2022] DELETE /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb/os-volume_attachments/dd7119c2-6ecb-449d-a6f3-e56d748ec18f => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:14:39.140707 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-a7a3d0bf-eaaa-479c-80e4-88d6f0dff483 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:39.143270 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-a7a3d0bf-eaaa-479c-80e4-88d6f0dff483 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:39.156011 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a7a3d0bf-eaaa-479c-80e4-88d6f0dff483 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:39.156850 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a7a3d0bf-eaaa-479c-80e4-88d6f0dff483 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:39.158266 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a7a3d0bf-eaaa-479c-80e4-88d6f0dff483 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:39.159107 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a7a3d0bf-eaaa-479c-80e4-88d6f0dff483 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:39.223910 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-a7a3d0bf-eaaa-479c-80e4-88d6f0dff483 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091872 Feb 09 13:14:39.224780 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 270/524] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:14:39 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:14:39.264330 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-84ce3caf-a63e-4381-998b-a3e45def279d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:39.273862 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-84ce3caf-a63e-4381-998b-a3e45def279d tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1560 microversion: 2.1 time: 0.199947 Feb 09 13:14:39.274433 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 255/525] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:39 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1560 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:39.355422 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-01c62219-6fd4-4b5c-91a5-0ba567104141 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:39.355921 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-01c62219-6fd4-4b5c-91a5-0ba567104141 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:39.361832 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-01c62219-6fd4-4b5c-91a5-0ba567104141 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:39.362290 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-01c62219-6fd4-4b5c-91a5-0ba567104141 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:39.363108 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-01c62219-6fd4-4b5c-91a5-0ba567104141 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:39.363547 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-01c62219-6fd4-4b5c-91a5-0ba567104141 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:39.452948 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-01c62219-6fd4-4b5c-91a5-0ba567104141 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lazy-loading 'services' on Instance uuid 6851d5fe-b010-49cc-8696-19a1008c2beb {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:14:39.686093 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-01c62219-6fd4-4b5c-91a5-0ba567104141 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "DELETE /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/os-volume_attachments/facb3b3e-fda6-4c94-96d6-e2b44bb5793f" status: 202 len: 0 microversion: 2.1 time: 0.334393 Feb 09 13:14:39.687067 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 271/526] 10.222.0.84 () {58 vars in 1415 bytes} [Wed Feb 9 13:14:39 2022] DELETE /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/os-volume_attachments/facb3b3e-fda6-4c94-96d6-e2b44bb5793f => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:14:39.694947 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-25f84ab3-d431-4b6c-90c1-ad2a8bef8dd7 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:39.696046 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-25f84ab3-d431-4b6c-90c1-ad2a8bef8dd7 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:39.712812 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-25f84ab3-d431-4b6c-90c1-ad2a8bef8dd7 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:39.713502 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-25f84ab3-d431-4b6c-90c1-ad2a8bef8dd7 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:39.714300 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-25f84ab3-d431-4b6c-90c1-ad2a8bef8dd7 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:39.714768 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-25f84ab3-d431-4b6c-90c1-ad2a8bef8dd7 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:39.744919 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-25f84ab3-d431-4b6c-90c1-ad2a8bef8dd7 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053670 Feb 09 13:14:39.745481 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 256/527] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:14:39 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:14:40.046658 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-ddc982b7-0594-4da3-9876-d990f2daf0f5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:40.047394 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-ddc982b7-0594-4da3-9876-d990f2daf0f5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:40.054197 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ddc982b7-0594-4da3-9876-d990f2daf0f5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:40.054669 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ddc982b7-0594-4da3-9876-d990f2daf0f5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:40.058917 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ddc982b7-0594-4da3-9876-d990f2daf0f5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:40.058917 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ddc982b7-0594-4da3-9876-d990f2daf0f5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:40.195634 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ddc982b7-0594-4da3-9876-d990f2daf0f5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:40.204159 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ddc982b7-0594-4da3-9876-d990f2daf0f5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:40.205682 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ddc982b7-0594-4da3-9876-d990f2daf0f5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:40.206974 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-ddc982b7-0594-4da3-9876-d990f2daf0f5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1721 microversion: 2.20 time: 0.164708 Feb 09 13:14:40.207663 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 272/528] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:40 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:40.235512 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-003f9b7b-f603-4e99-a7c2-7210b5f32233 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:40.236570 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-003f9b7b-f603-4e99-a7c2-7210b5f32233 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:40.243129 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-003f9b7b-f603-4e99-a7c2-7210b5f32233 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:40.243578 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-003f9b7b-f603-4e99-a7c2-7210b5f32233 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:40.245081 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-003f9b7b-f603-4e99-a7c2-7210b5f32233 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:40.245521 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-003f9b7b-f603-4e99-a7c2-7210b5f32233 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:40.276795 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-003f9b7b-f603-4e99-a7c2-7210b5f32233 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045056 Feb 09 13:14:40.277362 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 257/529] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:14:40 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:14:40.755634 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-b5f4a382-0cef-4913-902e-8e2864bafcf9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:40.756765 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-b5f4a382-0cef-4913-902e-8e2864bafcf9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:40.763321 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b5f4a382-0cef-4913-902e-8e2864bafcf9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:40.764107 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b5f4a382-0cef-4913-902e-8e2864bafcf9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:40.764906 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b5f4a382-0cef-4913-902e-8e2864bafcf9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:40.765349 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b5f4a382-0cef-4913-902e-8e2864bafcf9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:40.797060 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-b5f4a382-0cef-4913-902e-8e2864bafcf9 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045066 Feb 09 13:14:40.797645 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 273/530] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:14:40 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:14:41.225198 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-6fb1ac56-10f6-4a04-b8e0-2b6ae6c4b1ad tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:41.225803 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-6fb1ac56-10f6-4a04-b8e0-2b6ae6c4b1ad tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:41.232228 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6fb1ac56-10f6-4a04-b8e0-2b6ae6c4b1ad tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:41.232677 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6fb1ac56-10f6-4a04-b8e0-2b6ae6c4b1ad tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:41.233457 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6fb1ac56-10f6-4a04-b8e0-2b6ae6c4b1ad tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:41.233897 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6fb1ac56-10f6-4a04-b8e0-2b6ae6c4b1ad tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:41.288127 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-737c01fe-2028-4c3f-a8da-b5e49a3853cc tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:41.289073 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-737c01fe-2028-4c3f-a8da-b5e49a3853cc tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:41.296252 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-737c01fe-2028-4c3f-a8da-b5e49a3853cc tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:41.296706 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-737c01fe-2028-4c3f-a8da-b5e49a3853cc tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:41.297501 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-737c01fe-2028-4c3f-a8da-b5e49a3853cc tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:41.297945 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-737c01fe-2028-4c3f-a8da-b5e49a3853cc tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:41.326733 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-737c01fe-2028-4c3f-a8da-b5e49a3853cc tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042358 Feb 09 13:14:41.327308 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 274/531] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:14:41 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 09 13:14:41.368608 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6fb1ac56-10f6-4a04-b8e0-2b6ae6c4b1ad tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:41.376617 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6fb1ac56-10f6-4a04-b8e0-2b6ae6c4b1ad tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:41.378402 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6fb1ac56-10f6-4a04-b8e0-2b6ae6c4b1ad tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:41.380044 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-6fb1ac56-10f6-4a04-b8e0-2b6ae6c4b1ad tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1742 microversion: 2.20 time: 0.158415 Feb 09 13:14:41.380697 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 258/532] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:41 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:41.808344 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d922c3f2-0f6a-4400-9bb1-fc4e8d09daf4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:41.809373 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d922c3f2-0f6a-4400-9bb1-fc4e8d09daf4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:41.815405 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d922c3f2-0f6a-4400-9bb1-fc4e8d09daf4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:41.817341 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d922c3f2-0f6a-4400-9bb1-fc4e8d09daf4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:41.817341 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d922c3f2-0f6a-4400-9bb1-fc4e8d09daf4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:41.817341 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d922c3f2-0f6a-4400-9bb1-fc4e8d09daf4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:41.850940 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d922c3f2-0f6a-4400-9bb1-fc4e8d09daf4 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045379 Feb 09 13:14:41.850940 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 275/533] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:14:41 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:14:41.882600 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-13129899-3e8c-4aa5-98f4-a1b4b136af7d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-628409038", "imageRef": "af86cedd-e7d5-4a28-a810-f47830f4bffc", "flavorRef": "452"}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:14:41.931239 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.network.neutron [None req-13129899-3e8c-4aa5-98f4-a1b4b136af7d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] validate_networks() for None {{(pid=116749) validate_networks /opt/stack/nova/nova/network/neutron.py:2554}} Feb 09 13:14:42.225468 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-13129899-3e8c-4aa5-98f4-a1b4b136af7d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Flavor limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 09 13:14:42.225893 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-13129899-3e8c-4aa5-98f4-a1b4b136af7d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Image limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 09 13:14:42.226502 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-13129899-3e8c-4aa5-98f4-a1b4b136af7d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Flavor pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 09 13:14:42.226940 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-13129899-3e8c-4aa5-98f4-a1b4b136af7d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Image pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 09 13:14:42.227380 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-13129899-3e8c-4aa5-98f4-a1b4b136af7d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 09 13:14:42.237228 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-13129899-3e8c-4aa5-98f4-a1b4b136af7d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:42.238677 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-13129899-3e8c-4aa5-98f4-a1b4b136af7d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:42.238677 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-13129899-3e8c-4aa5-98f4-a1b4b136af7d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:42.238965 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-13129899-3e8c-4aa5-98f4-a1b4b136af7d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:42.255584 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-13129899-3e8c-4aa5-98f4-a1b4b136af7d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Getting quotas for project 834752705fcb4325a3852c8b613c394f. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:14:42.259580 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-13129899-3e8c-4aa5-98f4-a1b4b136af7d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Getting quotas for user 30762c3987d84d1cbef38befef535d00 and project 834752705fcb4325a3852c8b613c394f. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:14:42.270847 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-13129899-3e8c-4aa5-98f4-a1b4b136af7d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Going to run 1 instances... {{(pid=116749) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 09 13:14:42.273360 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-13129899-3e8c-4aa5-98f4-a1b4b136af7d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af86cedd-e7d5-4a28-a810-f47830f4bffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 09 13:14:42.400176 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-bbd71e1d-7162-4093-bcd0-7c17417b2f75 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:42.400885 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-bbd71e1d-7162-4093-bcd0-7c17417b2f75 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:42.407359 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bbd71e1d-7162-4093-bcd0-7c17417b2f75 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:42.407805 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bbd71e1d-7162-4093-bcd0-7c17417b2f75 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:42.408582 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bbd71e1d-7162-4093-bcd0-7c17417b2f75 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:42.409015 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bbd71e1d-7162-4093-bcd0-7c17417b2f75 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:42.449015 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-13129899-3e8c-4aa5-98f4-a1b4b136af7d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570159 Feb 09 13:14:42.449617 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 259/534] 10.222.0.84 () {60 vars in 1146 bytes} [Wed Feb 9 13:14:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 09 13:14:42.465874 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-f9b95d8d-e382-4981-b8fd-87a537a3c5fb tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:42.468613 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-f9b95d8d-e382-4981-b8fd-87a537a3c5fb tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:42.527629 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-f9b95d8d-e382-4981-b8fd-87a537a3c5fb tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:42.534230 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-f9b95d8d-e382-4981-b8fd-87a537a3c5fb tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1214 microversion: 2.1 time: 0.077795 Feb 09 13:14:42.543542 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 260/535] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:42 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:42.559735 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-bbd71e1d-7162-4093-bcd0-7c17417b2f75 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:42.569138 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-bbd71e1d-7162-4093-bcd0-7c17417b2f75 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:42.570662 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-bbd71e1d-7162-4093-bcd0-7c17417b2f75 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:42.572514 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-bbd71e1d-7162-4093-bcd0-7c17417b2f75 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1742 microversion: 2.20 time: 0.175626 Feb 09 13:14:42.573084 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 276/536] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:42 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1742 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:14:42.683673 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-a82ab031-c71f-401b-bfe5-1fe9139118bf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:42.694129 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-a82ab031-c71f-401b-bfe5-1fe9139118bf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:42.694129 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a82ab031-c71f-401b-bfe5-1fe9139118bf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:42.694129 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a82ab031-c71f-401b-bfe5-1fe9139118bf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:42.694129 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a82ab031-c71f-401b-bfe5-1fe9139118bf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:42.694498 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a82ab031-c71f-401b-bfe5-1fe9139118bf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:42.717332 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-a82ab031-c71f-401b-bfe5-1fe9139118bf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Going to try to terminate instance {{(pid=116749) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 09 13:14:42.862146 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-0523e137-4a1e-4962-a37a-402a1d76ecc3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:42.863125 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-0523e137-4a1e-4962-a37a-402a1d76ecc3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:42.869127 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0523e137-4a1e-4962-a37a-402a1d76ecc3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:42.869587 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0523e137-4a1e-4962-a37a-402a1d76ecc3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:42.872282 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0523e137-4a1e-4962-a37a-402a1d76ecc3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:42.872282 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0523e137-4a1e-4962-a37a-402a1d76ecc3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:42.912541 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-0523e137-4a1e-4962-a37a-402a1d76ecc3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049378 Feb 09 13:14:42.912541 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 277/537] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:14:42 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 09 13:14:43.091633 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-a82ab031-c71f-401b-bfe5-1fe9139118bf tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "DELETE /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 204 len: 0 microversion: 2.1 time: 0.411441 Feb 09 13:14:43.092422 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 261/538] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:14:42 2022] DELETE /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 09 13:14:43.100024 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-8fcdeb2a-f445-4039-bab8-a7e13891d029 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:43.100635 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-8fcdeb2a-f445-4039-bab8-a7e13891d029 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:43.106435 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8fcdeb2a-f445-4039-bab8-a7e13891d029 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:43.106918 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8fcdeb2a-f445-4039-bab8-a7e13891d029 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:43.107706 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8fcdeb2a-f445-4039-bab8-a7e13891d029 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:43.108142 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8fcdeb2a-f445-4039-bab8-a7e13891d029 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:43.251284 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-8fcdeb2a-f445-4039-bab8-a7e13891d029 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:43.258430 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-8fcdeb2a-f445-4039-bab8-a7e13891d029 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1514 microversion: 2.1 time: 0.161883 Feb 09 13:14:43.259253 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 278/539] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:43 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:43.550781 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-def1b7e8-4b69-4cd3-abb2-235546fc4f66 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:43.551402 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-def1b7e8-4b69-4cd3-abb2-235546fc4f66 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:43.558648 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-def1b7e8-4b69-4cd3-abb2-235546fc4f66 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:43.559120 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-def1b7e8-4b69-4cd3-abb2-235546fc4f66 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:43.559916 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-def1b7e8-4b69-4cd3-abb2-235546fc4f66 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:43.560361 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-def1b7e8-4b69-4cd3-abb2-235546fc4f66 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:43.591369 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-598e1fa5-32ca-41f7-9715-62e1df36fe15 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:43.592510 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-598e1fa5-32ca-41f7-9715-62e1df36fe15 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:43.599597 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-598e1fa5-32ca-41f7-9715-62e1df36fe15 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:43.606595 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-598e1fa5-32ca-41f7-9715-62e1df36fe15 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:43.606595 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-598e1fa5-32ca-41f7-9715-62e1df36fe15 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:43.606595 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-598e1fa5-32ca-41f7-9715-62e1df36fe15 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:43.642388 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-def1b7e8-4b69-4cd3-abb2-235546fc4f66 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:43.650468 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-def1b7e8-4b69-4cd3-abb2-235546fc4f66 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1218 microversion: 2.1 time: 0.103527 Feb 09 13:14:43.651365 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 262/540] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:43 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:43.745561 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-598e1fa5-32ca-41f7-9715-62e1df36fe15 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:43.753311 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-598e1fa5-32ca-41f7-9715-62e1df36fe15 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:43.754856 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-598e1fa5-32ca-41f7-9715-62e1df36fe15 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:43.756014 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-598e1fa5-32ca-41f7-9715-62e1df36fe15 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1742 microversion: 2.20 time: 0.169096 Feb 09 13:14:43.756758 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 279/541] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:43 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1742 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:14:44.276517 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8b4ff14b-2144-4082-871a-097dfa4ccac1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:44.277662 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8b4ff14b-2144-4082-871a-097dfa4ccac1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:44.284148 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8b4ff14b-2144-4082-871a-097dfa4ccac1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:44.284148 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8b4ff14b-2144-4082-871a-097dfa4ccac1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:44.287737 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8b4ff14b-2144-4082-871a-097dfa4ccac1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:44.287737 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8b4ff14b-2144-4082-871a-097dfa4ccac1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:44.424839 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8b4ff14b-2144-4082-871a-097dfa4ccac1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:44.432299 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8b4ff14b-2144-4082-871a-097dfa4ccac1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1514 microversion: 2.1 time: 0.160054 Feb 09 13:14:44.437097 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 263/542] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:44 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:44.666692 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-165f403f-0ab4-4664-a952-bf4957001b67 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:44.667283 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-165f403f-0ab4-4664-a952-bf4957001b67 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:44.673525 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-165f403f-0ab4-4664-a952-bf4957001b67 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:44.673913 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-165f403f-0ab4-4664-a952-bf4957001b67 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:44.674817 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-165f403f-0ab4-4664-a952-bf4957001b67 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:44.675259 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-165f403f-0ab4-4664-a952-bf4957001b67 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:44.736579 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-165f403f-0ab4-4664-a952-bf4957001b67 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:44.744367 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-165f403f-0ab4-4664-a952-bf4957001b67 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1266 microversion: 2.1 time: 0.080671 Feb 09 13:14:44.744948 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 280/543] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:44 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:44.774835 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-68f1f4b4-e439-4115-b27a-ebb6efa2eaf7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:44.775785 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-68f1f4b4-e439-4115-b27a-ebb6efa2eaf7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:44.783022 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-68f1f4b4-e439-4115-b27a-ebb6efa2eaf7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:44.783761 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-68f1f4b4-e439-4115-b27a-ebb6efa2eaf7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:44.785789 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-68f1f4b4-e439-4115-b27a-ebb6efa2eaf7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:44.787104 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-68f1f4b4-e439-4115-b27a-ebb6efa2eaf7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:44.958627 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-68f1f4b4-e439-4115-b27a-ebb6efa2eaf7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:44.969692 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-68f1f4b4-e439-4115-b27a-ebb6efa2eaf7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:44.996564 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-68f1f4b4-e439-4115-b27a-ebb6efa2eaf7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:44.998153 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-68f1f4b4-e439-4115-b27a-ebb6efa2eaf7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1737 microversion: 2.20 time: 0.227065 Feb 09 13:14:45.035642 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 264/544] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:44 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1737 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:45.235396 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-b4491001-9322-4a0e-b749-f897104182c0 req-9f5d638f-a753-4fb9-9623-282c3de9bc29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267a95df-7ddb-4e9c-a629-4fc26b9c9843", "name": "network-vif-plugged", "status": "completed", "tag": "45e332d3-92b6-4aa9-9b18-a8fa5ca22e31"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:14:45.237458 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:14:45.237458 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:14:45.255019 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-b4491001-9322-4a0e-b749-f897104182c0 req-9f5d638f-a753-4fb9-9623-282c3de9bc29 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:45.255497 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-b4491001-9322-4a0e-b749-f897104182c0 req-9f5d638f-a753-4fb9-9623-282c3de9bc29 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:45.281651 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-b4491001-9322-4a0e-b749-f897104182c0 req-9f5d638f-a753-4fb9-9623-282c3de9bc29 service nova] Creating event network-vif-plugged:45e332d3-92b6-4aa9-9b18-a8fa5ca22e31 for instance 267a95df-7ddb-4e9c-a629-4fc26b9c9843 on hv-cinder-82786 Feb 09 13:14:45.287630 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-b4491001-9322-4a0e-b749-f897104182c0 req-9f5d638f-a753-4fb9-9623-282c3de9bc29 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056598 Feb 09 13:14:45.288439 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 281/545] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:14:45.458753 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d55c5466-7a56-454d-a8f1-c3a22a652c3d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:45.459516 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d55c5466-7a56-454d-a8f1-c3a22a652c3d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:45.468461 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d55c5466-7a56-454d-a8f1-c3a22a652c3d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:45.468975 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d55c5466-7a56-454d-a8f1-c3a22a652c3d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:45.469757 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d55c5466-7a56-454d-a8f1-c3a22a652c3d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:45.470467 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d55c5466-7a56-454d-a8f1-c3a22a652c3d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:45.549024 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-eb590152-2f33-4a9b-a6a2-7b6ba63a39f1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:45.549856 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-eb590152-2f33-4a9b-a6a2-7b6ba63a39f1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:45.567452 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-eb590152-2f33-4a9b-a6a2-7b6ba63a39f1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:45.567905 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-eb590152-2f33-4a9b-a6a2-7b6ba63a39f1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:45.568978 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-eb590152-2f33-4a9b-a6a2-7b6ba63a39f1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:45.569578 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-eb590152-2f33-4a9b-a6a2-7b6ba63a39f1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:45.607384 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-eb590152-2f33-4a9b-a6a2-7b6ba63a39f1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Going to try to terminate instance {{(pid=116748) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 09 13:14:45.887750 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-d55c5466-7a56-454d-a8f1-c3a22a652c3d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:45.899576 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d55c5466-7a56-454d-a8f1-c3a22a652c3d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1514 microversion: 2.1 time: 0.454110 Feb 09 13:14:45.901611 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 265/546] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:45 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1514 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:45.906180 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-9efd7078-5671-48ee-8136-faf0232b0cc4 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:45.907017 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-9efd7078-5671-48ee-8136-faf0232b0cc4 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:45.916456 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9efd7078-5671-48ee-8136-faf0232b0cc4 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:45.917083 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9efd7078-5671-48ee-8136-faf0232b0cc4 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:45.918064 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9efd7078-5671-48ee-8136-faf0232b0cc4 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:45.918760 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9efd7078-5671-48ee-8136-faf0232b0cc4 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:46.042440 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-9efd7078-5671-48ee-8136-faf0232b0cc4 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:46.057446 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-9efd7078-5671-48ee-8136-faf0232b0cc4 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1272 microversion: 2.1 time: 0.153644 Feb 09 13:14:46.068402 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 266/547] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:45 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:46.073876 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-3b5a21e1-1e3a-422d-8139-a409d255345e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:46.074755 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-3b5a21e1-1e3a-422d-8139-a409d255345e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:46.094999 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-eb590152-2f33-4a9b-a6a2-7b6ba63a39f1 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "DELETE /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 204 len: 0 microversion: 2.1 time: 0.553928 Feb 09 13:14:46.095500 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3b5a21e1-1e3a-422d-8139-a409d255345e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:46.099562 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3b5a21e1-1e3a-422d-8139-a409d255345e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:46.099753 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 282/548] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:14:45 2022] DELETE /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 0 bytes in 557 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 09 13:14:46.105022 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-9a2c7734-5d7f-4e7e-8928-f4ed5365dad6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:46.105732 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-9a2c7734-5d7f-4e7e-8928-f4ed5365dad6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:46.114293 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3b5a21e1-1e3a-422d-8139-a409d255345e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:46.114904 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3b5a21e1-1e3a-422d-8139-a409d255345e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:46.121125 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9a2c7734-5d7f-4e7e-8928-f4ed5365dad6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:46.123270 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9a2c7734-5d7f-4e7e-8928-f4ed5365dad6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:46.128879 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9a2c7734-5d7f-4e7e-8928-f4ed5365dad6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:46.128879 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9a2c7734-5d7f-4e7e-8928-f4ed5365dad6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:46.315158 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-9a2c7734-5d7f-4e7e-8928-f4ed5365dad6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:46.327360 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-9a2c7734-5d7f-4e7e-8928-f4ed5365dad6 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1506 microversion: 2.1 time: 0.225949 Feb 09 13:14:46.328573 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 283/549] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:46 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1506 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:46.518386 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3b5a21e1-1e3a-422d-8139-a409d255345e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:46.530269 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3b5a21e1-1e3a-422d-8139-a409d255345e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:46.532160 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3b5a21e1-1e3a-422d-8139-a409d255345e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:46.533628 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-3b5a21e1-1e3a-422d-8139-a409d255345e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1737 microversion: 2.20 time: 0.464131 Feb 09 13:14:46.547645 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 267/550] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:46 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1737 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:46.815569 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-594e31f7-fde0-45d5-bbe0-f266c38d9924 req-acf6247b-395e-42e9-8d6b-6860194827b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed41059-48cc-4ddb-9a00-62f0c71f7dcb", "name": "network-vif-deleted", "tag": "5ce76bf6-0f9b-4cfe-bf46-e82256a2d39f"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:14:46.819262 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:14:46.819262 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:14:46.831762 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-594e31f7-fde0-45d5-bbe0-f266c38d9924 req-acf6247b-395e-42e9-8d6b-6860194827b5 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:46.832773 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-594e31f7-fde0-45d5-bbe0-f266c38d9924 req-acf6247b-395e-42e9-8d6b-6860194827b5 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:46.857370 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-594e31f7-fde0-45d5-bbe0-f266c38d9924 req-acf6247b-395e-42e9-8d6b-6860194827b5 service nova] Creating event network-vif-deleted:5ce76bf6-0f9b-4cfe-bf46-e82256a2d39f for instance bed41059-48cc-4ddb-9a00-62f0c71f7dcb on hv-cinder-82786 Feb 09 13:14:46.870959 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-594e31f7-fde0-45d5-bbe0-f266c38d9924 req-acf6247b-395e-42e9-8d6b-6860194827b5 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057301 Feb 09 13:14:46.872362 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 284/551] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:14:46.917996 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-38dfcadd-a213-488d-9c16-dff67246ed4c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:46.919697 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-38dfcadd-a213-488d-9c16-dff67246ed4c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:46.928550 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-38dfcadd-a213-488d-9c16-dff67246ed4c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:46.930441 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-38dfcadd-a213-488d-9c16-dff67246ed4c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:46.932661 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-38dfcadd-a213-488d-9c16-dff67246ed4c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:46.933756 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-38dfcadd-a213-488d-9c16-dff67246ed4c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:47.033169 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-38dfcadd-a213-488d-9c16-dff67246ed4c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:47.055649 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-38dfcadd-a213-488d-9c16-dff67246ed4c tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1472 microversion: 2.1 time: 0.142004 Feb 09 13:14:47.060031 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 268/552] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:46 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1472 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:47.081611 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-fe6ecd35-7031-4c7e-b680-387d0b0d2138 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:47.082654 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-fe6ecd35-7031-4c7e-b680-387d0b0d2138 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:47.090837 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fe6ecd35-7031-4c7e-b680-387d0b0d2138 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:47.091281 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fe6ecd35-7031-4c7e-b680-387d0b0d2138 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:47.092070 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fe6ecd35-7031-4c7e-b680-387d0b0d2138 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:47.092705 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fe6ecd35-7031-4c7e-b680-387d0b0d2138 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:47.187456 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-fe6ecd35-7031-4c7e-b680-387d0b0d2138 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:47.198098 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-fe6ecd35-7031-4c7e-b680-387d0b0d2138 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1272 microversion: 2.1 time: 0.122187 Feb 09 13:14:47.199118 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 285/553] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:47 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1272 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:47.381607 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-9895db23-e45b-43af-bc98-3be5f0cb898f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:47.381607 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-9895db23-e45b-43af-bc98-3be5f0cb898f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:47.381607 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9895db23-e45b-43af-bc98-3be5f0cb898f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:47.381607 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9895db23-e45b-43af-bc98-3be5f0cb898f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:47.383648 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9895db23-e45b-43af-bc98-3be5f0cb898f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:47.383648 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9895db23-e45b-43af-bc98-3be5f0cb898f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:47.526318 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-9895db23-e45b-43af-bc98-3be5f0cb898f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:47.553850 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-9895db23-e45b-43af-bc98-3be5f0cb898f tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1506 microversion: 2.1 time: 0.212091 Feb 09 13:14:47.559380 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-cc6524bb-814f-4612-a257-0f7b7328ffdd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:47.563578 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-cc6524bb-814f-4612-a257-0f7b7328ffdd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:47.564542 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 269/554] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:47 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:47.571377 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cc6524bb-814f-4612-a257-0f7b7328ffdd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:47.572309 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cc6524bb-814f-4612-a257-0f7b7328ffdd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:47.573236 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cc6524bb-814f-4612-a257-0f7b7328ffdd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:47.573682 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cc6524bb-814f-4612-a257-0f7b7328ffdd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:47.832627 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-cc6524bb-814f-4612-a257-0f7b7328ffdd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:47.848611 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-cc6524bb-814f-4612-a257-0f7b7328ffdd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:47.851100 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-cc6524bb-814f-4612-a257-0f7b7328ffdd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:47.854210 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-cc6524bb-814f-4612-a257-0f7b7328ffdd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1737 microversion: 2.20 time: 0.301327 Feb 09 13:14:47.854923 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 286/555] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:47 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1737 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:48.229055 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-6e1f7ffd-7cd6-42ea-aba0-d6d197f02b3f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:48.229055 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-6e1f7ffd-7cd6-42ea-aba0-d6d197f02b3f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:48.229055 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6e1f7ffd-7cd6-42ea-aba0-d6d197f02b3f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:48.229055 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6e1f7ffd-7cd6-42ea-aba0-d6d197f02b3f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:48.231088 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6e1f7ffd-7cd6-42ea-aba0-d6d197f02b3f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:48.231088 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6e1f7ffd-7cd6-42ea-aba0-d6d197f02b3f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:48.231088 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6e1f7ffd-7cd6-42ea-aba0-d6d197f02b3f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:48.231088 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6e1f7ffd-7cd6-42ea-aba0-d6d197f02b3f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:48.231339 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.objects.instance [None req-6e1f7ffd-7cd6-42ea-aba0-d6d197f02b3f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lazy-loading 'fault' on Instance uuid bed41059-48cc-4ddb-9a00-62f0c71f7dcb {{(pid=116749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:14:48.231339 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6e1f7ffd-7cd6-42ea-aba0-d6d197f02b3f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:48.231339 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-6e1f7ffd-7cd6-42ea-aba0-d6d197f02b3f tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 200 len: 1308 microversion: 2.1 time: 0.123623 Feb 09 13:14:48.231339 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 270/556] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:48 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 1308 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:48.231637 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-5ea3c3e5-7c28-4129-8eb5-86751bbb49a5 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:48.231637 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-5ea3c3e5-7c28-4129-8eb5-86751bbb49a5 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:48.231637 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5ea3c3e5-7c28-4129-8eb5-86751bbb49a5 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:48.231637 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5ea3c3e5-7c28-4129-8eb5-86751bbb49a5 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:48.232305 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5ea3c3e5-7c28-4129-8eb5-86751bbb49a5 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:48.232305 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5ea3c3e5-7c28-4129-8eb5-86751bbb49a5 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:48.384880 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-5ea3c3e5-7c28-4129-8eb5-86751bbb49a5 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:48.405763 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-5ea3c3e5-7c28-4129-8eb5-86751bbb49a5 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1314 microversion: 2.1 time: 0.193409 Feb 09 13:14:48.406610 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 287/557] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:48 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:48.579442 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-b59631e8-9fb1-4144-a0b9-b934317a5f21 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:48.579442 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-b59631e8-9fb1-4144-a0b9-b934317a5f21 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:48.586086 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b59631e8-9fb1-4144-a0b9-b934317a5f21 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:48.586472 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b59631e8-9fb1-4144-a0b9-b934317a5f21 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:48.591204 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b59631e8-9fb1-4144-a0b9-b934317a5f21 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:48.591835 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b59631e8-9fb1-4144-a0b9-b934317a5f21 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:48.874297 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-b59631e8-9fb1-4144-a0b9-b934317a5f21 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:48.875565 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-1e2e7b8a-5f94-4532-9b3d-936e98b4783c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:48.876289 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-1e2e7b8a-5f94-4532-9b3d-936e98b4783c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:48.885314 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-b59631e8-9fb1-4144-a0b9-b934317a5f21 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1506 microversion: 2.1 time: 0.317146 Feb 09 13:14:48.886471 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 271/558] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:48 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1506 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:48.924892 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1e2e7b8a-5f94-4532-9b3d-936e98b4783c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:48.925403 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1e2e7b8a-5f94-4532-9b3d-936e98b4783c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:48.926264 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1e2e7b8a-5f94-4532-9b3d-936e98b4783c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:48.926795 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1e2e7b8a-5f94-4532-9b3d-936e98b4783c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:49.038411 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-ff3854e7-27b3-497c-8da0-bdcd4bb48d5d req-d7e7c41f-1d79-4f6e-b34e-992f7b53f73d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b56fd141-d0a7-42c4-a21f-fde932c567ad", "tag": "fd22a251-c76d-4b92-abb9-ba8c6ffd24ff"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:14:49.040864 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:14:49.040864 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:14:49.055533 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-ff3854e7-27b3-497c-8da0-bdcd4bb48d5d req-d7e7c41f-1d79-4f6e-b34e-992f7b53f73d service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:49.059036 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-ff3854e7-27b3-497c-8da0-bdcd4bb48d5d req-d7e7c41f-1d79-4f6e-b34e-992f7b53f73d service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:49.071670 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-ff3854e7-27b3-497c-8da0-bdcd4bb48d5d req-d7e7c41f-1d79-4f6e-b34e-992f7b53f73d service nova] Creating event network-changed:fd22a251-c76d-4b92-abb9-ba8c6ffd24ff for instance b56fd141-d0a7-42c4-a21f-fde932c567ad on hv-cinder-82786 Feb 09 13:14:49.077744 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-ff3854e7-27b3-497c-8da0-bdcd4bb48d5d req-d7e7c41f-1d79-4f6e-b34e-992f7b53f73d service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046629 Feb 09 13:14:49.079068 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 272/559] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Feb 09 13:14:49.124642 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-1e2e7b8a-5f94-4532-9b3d-936e98b4783c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:49.135088 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-1e2e7b8a-5f94-4532-9b3d-936e98b4783c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:49.140004 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-1e2e7b8a-5f94-4532-9b3d-936e98b4783c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:49.141397 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-1e2e7b8a-5f94-4532-9b3d-936e98b4783c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1737 microversion: 2.20 time: 0.272505 Feb 09 13:14:49.142410 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 288/560] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:48 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1737 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:14:49.211518 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ec74428f-a07c-4147-9bed-19330295f4cd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:49.213053 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-ec74428f-a07c-4147-9bed-19330295f4cd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: bed41059-48cc-4ddb-9a00-62f0c71f7dcb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:49.227775 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ec74428f-a07c-4147-9bed-19330295f4cd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:49.228573 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ec74428f-a07c-4147-9bed-19330295f4cd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:49.229578 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ec74428f-a07c-4147-9bed-19330295f4cd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:49.231424 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ec74428f-a07c-4147-9bed-19330295f4cd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:49.251229 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-ec74428f-a07c-4147-9bed-19330295f4cd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] HTTP exception thrown: Instance bed41059-48cc-4ddb-9a00-62f0c71f7dcb could not be found. Feb 09 13:14:49.252237 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ec74428f-a07c-4147-9bed-19330295f4cd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Returning 404 to user: Instance bed41059-48cc-4ddb-9a00-62f0c71f7dcb could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:14:49.253531 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-ec74428f-a07c-4147-9bed-19330295f4cd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb" status: 404 len: 111 microversion: 2.1 time: 0.046314 Feb 09 13:14:49.257390 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 273/561] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:49 2022] GET /compute/v2.1/servers/bed41059-48cc-4ddb-9a00-62f0c71f7dcb => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:14:49.422114 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-aa83e5fd-89b9-41e6-80b8-96e3de7159ac tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:49.422778 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-aa83e5fd-89b9-41e6-80b8-96e3de7159ac tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:49.429753 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-aa83e5fd-89b9-41e6-80b8-96e3de7159ac tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:49.430189 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-aa83e5fd-89b9-41e6-80b8-96e3de7159ac tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:49.431588 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-aa83e5fd-89b9-41e6-80b8-96e3de7159ac tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:49.432030 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-aa83e5fd-89b9-41e6-80b8-96e3de7159ac tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:49.640301 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-aa83e5fd-89b9-41e6-80b8-96e3de7159ac tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:49.654391 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-aa83e5fd-89b9-41e6-80b8-96e3de7159ac tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1314 microversion: 2.1 time: 0.234326 Feb 09 13:14:49.654657 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 289/562] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:49 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:49.926652 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ffd86e1a-a7ac-4e7c-8aa7-10b55794138b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:49.927733 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-ffd86e1a-a7ac-4e7c-8aa7-10b55794138b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:49.935011 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ffd86e1a-a7ac-4e7c-8aa7-10b55794138b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:49.935779 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ffd86e1a-a7ac-4e7c-8aa7-10b55794138b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:49.936778 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ffd86e1a-a7ac-4e7c-8aa7-10b55794138b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:49.937421 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ffd86e1a-a7ac-4e7c-8aa7-10b55794138b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:50.054523 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ffd86e1a-a7ac-4e7c-8aa7-10b55794138b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:50.067753 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-ffd86e1a-a7ac-4e7c-8aa7-10b55794138b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1464 microversion: 2.1 time: 0.144825 Feb 09 13:14:50.069328 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 274/563] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:49 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:50.161551 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-f9164e00-3cd4-4047-922e-8d8f315db2f1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:50.162814 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-f9164e00-3cd4-4047-922e-8d8f315db2f1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:50.177040 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f9164e00-3cd4-4047-922e-8d8f315db2f1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:50.179842 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f9164e00-3cd4-4047-922e-8d8f315db2f1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:50.180839 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f9164e00-3cd4-4047-922e-8d8f315db2f1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:50.181289 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f9164e00-3cd4-4047-922e-8d8f315db2f1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:50.357785 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f9164e00-3cd4-4047-922e-8d8f315db2f1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:50.368085 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f9164e00-3cd4-4047-922e-8d8f315db2f1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:50.369738 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f9164e00-3cd4-4047-922e-8d8f315db2f1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:50.371048 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-f9164e00-3cd4-4047-922e-8d8f315db2f1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1737 microversion: 2.20 time: 0.214538 Feb 09 13:14:50.378645 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 290/564] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:50 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:50.607840 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-7b59193e-cc2d-4ebc-8aed-3e9bd01cb4df tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:50.608285 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-7b59193e-cc2d-4ebc-8aed-3e9bd01cb4df tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:50.615084 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7b59193e-cc2d-4ebc-8aed-3e9bd01cb4df tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:50.615538 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7b59193e-cc2d-4ebc-8aed-3e9bd01cb4df tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:50.616342 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7b59193e-cc2d-4ebc-8aed-3e9bd01cb4df tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:50.616783 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7b59193e-cc2d-4ebc-8aed-3e9bd01cb4df tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:50.642216 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-7b59193e-cc2d-4ebc-8aed-3e9bd01cb4df tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Going to try to terminate instance {{(pid=116749) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 09 13:14:50.671282 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-2403495d-b844-459a-89c2-74171f24be75 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:50.671894 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-2403495d-b844-459a-89c2-74171f24be75 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:50.677601 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2403495d-b844-459a-89c2-74171f24be75 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:50.678064 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2403495d-b844-459a-89c2-74171f24be75 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:50.678879 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2403495d-b844-459a-89c2-74171f24be75 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:50.679327 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2403495d-b844-459a-89c2-74171f24be75 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:50.820228 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-2403495d-b844-459a-89c2-74171f24be75 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:50.828178 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-2403495d-b844-459a-89c2-74171f24be75 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1314 microversion: 2.1 time: 0.160539 Feb 09 13:14:50.828748 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 291/565] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:50 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:50.971005 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-7b59193e-cc2d-4ebc-8aed-3e9bd01cb4df tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "DELETE /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 204 len: 0 microversion: 2.1 time: 0.366681 Feb 09 13:14:50.971601 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 275/566] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:14:50 2022] DELETE /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 09 13:14:50.979506 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-ab8754ea-b616-4722-8b07-80f737331d60 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:50.980373 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-ab8754ea-b616-4722-8b07-80f737331d60 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:50.986269 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ab8754ea-b616-4722-8b07-80f737331d60 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:50.986755 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ab8754ea-b616-4722-8b07-80f737331d60 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:50.987542 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ab8754ea-b616-4722-8b07-80f737331d60 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:50.987978 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ab8754ea-b616-4722-8b07-80f737331d60 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:51.085520 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8b15106b-b543-422f-b42b-ca99515f2b95 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:51.089401 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8b15106b-b543-422f-b42b-ca99515f2b95 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:51.092900 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8b15106b-b543-422f-b42b-ca99515f2b95 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:51.093360 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8b15106b-b543-422f-b42b-ca99515f2b95 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:51.094163 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8b15106b-b543-422f-b42b-ca99515f2b95 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:51.094659 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8b15106b-b543-422f-b42b-ca99515f2b95 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:51.129490 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8b15106b-b543-422f-b42b-ca99515f2b95 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:51.129946 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8b15106b-b543-422f-b42b-ca99515f2b95 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:51.130433 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.objects.instance [None req-8b15106b-b543-422f-b42b-ca99515f2b95 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lazy-loading 'fault' on Instance uuid 8f002ff5-5d1f-4467-95ed-59f40d89a99d {{(pid=116749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:14:51.136389 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ab8754ea-b616-4722-8b07-80f737331d60 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:51.147228 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-ab8754ea-b616-4722-8b07-80f737331d60 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1513 microversion: 2.1 time: 0.171174 Feb 09 13:14:51.148075 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 292/567] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:50 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:51.174599 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-6205a1fa-49cc-4425-8b7b-a99df1216a55 req-92fef07a-4dff-461a-8397-e4b469881001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f002ff5-5d1f-4467-95ed-59f40d89a99d", "name": "network-vif-deleted", "tag": "f0f66d6e-dac2-4b65-a7f0-da58e82e9c63"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:14:51.176451 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:14:51.176451 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:14:51.198676 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-6205a1fa-49cc-4425-8b7b-a99df1216a55 req-92fef07a-4dff-461a-8397-e4b469881001 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:51.198676 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-6205a1fa-49cc-4425-8b7b-a99df1216a55 req-92fef07a-4dff-461a-8397-e4b469881001 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:51.205259 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-6205a1fa-49cc-4425-8b7b-a99df1216a55 req-92fef07a-4dff-461a-8397-e4b469881001 service nova] Creating event network-vif-deleted:f0f66d6e-dac2-4b65-a7f0-da58e82e9c63 for instance 8f002ff5-5d1f-4467-95ed-59f40d89a99d on hv-cinder-82786 Feb 09 13:14:51.212221 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8b15106b-b543-422f-b42b-ca99515f2b95 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:51.216873 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-6205a1fa-49cc-4425-8b7b-a99df1216a55 req-92fef07a-4dff-461a-8397-e4b469881001 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047659 Feb 09 13:14:51.217993 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 293/568] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:14:51.231534 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8b15106b-b543-422f-b42b-ca99515f2b95 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 200 len: 1312 microversion: 2.1 time: 0.149082 Feb 09 13:14:51.231534 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 276/569] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:51 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 1312 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:51.389887 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-1ca78558-b068-4701-b35c-bfd990d2513e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:51.390735 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-1ca78558-b068-4701-b35c-bfd990d2513e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:51.404155 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1ca78558-b068-4701-b35c-bfd990d2513e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:51.404797 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1ca78558-b068-4701-b35c-bfd990d2513e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:51.405806 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1ca78558-b068-4701-b35c-bfd990d2513e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:51.406361 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1ca78558-b068-4701-b35c-bfd990d2513e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:51.573342 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-1ca78558-b068-4701-b35c-bfd990d2513e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:51.583140 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-1ca78558-b068-4701-b35c-bfd990d2513e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:51.585030 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-1ca78558-b068-4701-b35c-bfd990d2513e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:51.586245 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-1ca78558-b068-4701-b35c-bfd990d2513e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1737 microversion: 2.20 time: 0.200717 Feb 09 13:14:51.597879 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 294/570] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:51 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:51.845831 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-e3a3bfe8-f354-418d-a01d-2d57e94df416 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:51.847287 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-e3a3bfe8-f354-418d-a01d-2d57e94df416 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:51.853975 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e3a3bfe8-f354-418d-a01d-2d57e94df416 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:51.854431 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e3a3bfe8-f354-418d-a01d-2d57e94df416 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:51.855285 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e3a3bfe8-f354-418d-a01d-2d57e94df416 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:51.855724 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e3a3bfe8-f354-418d-a01d-2d57e94df416 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:51.999326 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-e3a3bfe8-f354-418d-a01d-2d57e94df416 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:52.006745 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-e3a3bfe8-f354-418d-a01d-2d57e94df416 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1314 microversion: 2.1 time: 0.165609 Feb 09 13:14:52.016284 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 277/571] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:51 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:52.165363 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-f96389d3-275f-4d6e-9a30-3233b518ebbd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:52.165957 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-f96389d3-275f-4d6e-9a30-3233b518ebbd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:52.172262 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f96389d3-275f-4d6e-9a30-3233b518ebbd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:52.172714 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f96389d3-275f-4d6e-9a30-3233b518ebbd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:52.173522 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f96389d3-275f-4d6e-9a30-3233b518ebbd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:52.174196 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f96389d3-275f-4d6e-9a30-3233b518ebbd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:52.248685 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-4cc34cd6-4296-45db-87e1-0ac1072213e5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:52.249430 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-4cc34cd6-4296-45db-87e1-0ac1072213e5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 8f002ff5-5d1f-4467-95ed-59f40d89a99d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:52.256074 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4cc34cd6-4296-45db-87e1-0ac1072213e5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:52.256537 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4cc34cd6-4296-45db-87e1-0ac1072213e5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:52.262614 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4cc34cd6-4296-45db-87e1-0ac1072213e5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:52.262614 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4cc34cd6-4296-45db-87e1-0ac1072213e5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:52.274446 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-4cc34cd6-4296-45db-87e1-0ac1072213e5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] HTTP exception thrown: Instance 8f002ff5-5d1f-4467-95ed-59f40d89a99d could not be found. Feb 09 13:14:52.275355 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-4cc34cd6-4296-45db-87e1-0ac1072213e5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Returning 404 to user: Instance 8f002ff5-5d1f-4467-95ed-59f40d89a99d could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:14:52.276226 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-4cc34cd6-4296-45db-87e1-0ac1072213e5 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d" status: 404 len: 111 microversion: 2.1 time: 0.031211 Feb 09 13:14:52.280341 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 278/572] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:52 2022] GET /compute/v2.1/servers/8f002ff5-5d1f-4467-95ed-59f40d89a99d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 09 13:14:52.285091 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8273e2ea-3e4e-4789-983e-3748cdeb9e5a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:52.285657 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8273e2ea-3e4e-4789-983e-3748cdeb9e5a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:52.292037 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8273e2ea-3e4e-4789-983e-3748cdeb9e5a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:52.292483 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8273e2ea-3e4e-4789-983e-3748cdeb9e5a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:52.293264 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8273e2ea-3e4e-4789-983e-3748cdeb9e5a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:52.293694 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8273e2ea-3e4e-4789-983e-3748cdeb9e5a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:52.317899 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8273e2ea-3e4e-4789-983e-3748cdeb9e5a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Going to try to terminate instance {{(pid=116749) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 09 13:14:52.322663 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f96389d3-275f-4d6e-9a30-3233b518ebbd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:52.330012 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-f96389d3-275f-4d6e-9a30-3233b518ebbd tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1513 microversion: 2.1 time: 0.168374 Feb 09 13:14:52.330604 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 295/573] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:52 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:52.605133 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-cfa78f7c-b8f5-49b9-a402-dc8666bc7061 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:52.605752 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-cfa78f7c-b8f5-49b9-a402-dc8666bc7061 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:52.611827 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cfa78f7c-b8f5-49b9-a402-dc8666bc7061 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:52.612285 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cfa78f7c-b8f5-49b9-a402-dc8666bc7061 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:52.613070 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cfa78f7c-b8f5-49b9-a402-dc8666bc7061 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:52.613510 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cfa78f7c-b8f5-49b9-a402-dc8666bc7061 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:52.784301 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-cfa78f7c-b8f5-49b9-a402-dc8666bc7061 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:52.792765 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-cfa78f7c-b8f5-49b9-a402-dc8666bc7061 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:52.794235 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-cfa78f7c-b8f5-49b9-a402-dc8666bc7061 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:52.795402 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-cfa78f7c-b8f5-49b9-a402-dc8666bc7061 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1737 microversion: 2.20 time: 0.194549 Feb 09 13:14:52.795961 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 296/574] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:52 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:14:53.024061 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-af595612-4e0b-4d3e-96cd-1525f8a1d1d7 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:53.025719 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-af595612-4e0b-4d3e-96cd-1525f8a1d1d7 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:53.032427 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-af595612-4e0b-4d3e-96cd-1525f8a1d1d7 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:53.032948 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-af595612-4e0b-4d3e-96cd-1525f8a1d1d7 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:53.033887 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-af595612-4e0b-4d3e-96cd-1525f8a1d1d7 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:53.034795 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-af595612-4e0b-4d3e-96cd-1525f8a1d1d7 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:53.240021 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8273e2ea-3e4e-4789-983e-3748cdeb9e5a tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "DELETE /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 204 len: 0 microversion: 2.1 time: 0.958376 Feb 09 13:14:53.241595 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 279/575] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:14:52 2022] DELETE /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 0 bytes in 960 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 09 13:14:53.252165 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-da758907-35e1-4b23-bba1-ed711c46f7ec tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:53.253474 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-da758907-35e1-4b23-bba1-ed711c46f7ec tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:53.254947 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-af595612-4e0b-4d3e-96cd-1525f8a1d1d7 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:53.267996 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-da758907-35e1-4b23-bba1-ed711c46f7ec tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:53.268451 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-da758907-35e1-4b23-bba1-ed711c46f7ec tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:53.269248 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-da758907-35e1-4b23-bba1-ed711c46f7ec tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:53.269683 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-da758907-35e1-4b23-bba1-ed711c46f7ec tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:53.271154 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-af595612-4e0b-4d3e-96cd-1525f8a1d1d7 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1314 microversion: 2.1 time: 0.251048 Feb 09 13:14:53.272218 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 297/576] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:53 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:53.345966 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-ebfe690b-2f97-4243-8208-71c48d2a099b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:53.347867 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-ebfe690b-2f97-4243-8208-71c48d2a099b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:53.360398 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ebfe690b-2f97-4243-8208-71c48d2a099b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:53.361011 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ebfe690b-2f97-4243-8208-71c48d2a099b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:53.361933 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ebfe690b-2f97-4243-8208-71c48d2a099b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:53.362482 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ebfe690b-2f97-4243-8208-71c48d2a099b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:53.526016 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-da758907-35e1-4b23-bba1-ed711c46f7ec tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:53.537837 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-da758907-35e1-4b23-bba1-ed711c46f7ec tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.291607 Feb 09 13:14:53.539175 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 280/577] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:53 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:53.592668 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ebfe690b-2f97-4243-8208-71c48d2a099b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:53.627290 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-ebfe690b-2f97-4243-8208-71c48d2a099b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1513 microversion: 2.1 time: 0.280306 Feb 09 13:14:53.627290 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 298/578] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:53 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1513 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:53.715938 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-7874488e-4212-4af4-8aaa-def9394fea43 req-fe85ac44-4912-44f8-a178-a47349c55865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e5b30a-480d-4d7a-9944-88956c5cb510", "name": "network-vif-deleted", "tag": "fa72bf8a-1dd4-4729-8ef4-fef9bf8861a1"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:14:53.717621 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:14:53.717621 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:14:53.726865 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-7874488e-4212-4af4-8aaa-def9394fea43 req-fe85ac44-4912-44f8-a178-a47349c55865 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:53.727369 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-7874488e-4212-4af4-8aaa-def9394fea43 req-fe85ac44-4912-44f8-a178-a47349c55865 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:53.740621 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-7874488e-4212-4af4-8aaa-def9394fea43 req-fe85ac44-4912-44f8-a178-a47349c55865 service nova] Creating event network-vif-deleted:fa72bf8a-1dd4-4729-8ef4-fef9bf8861a1 for instance 64e5b30a-480d-4d7a-9944-88956c5cb510 on hv-cinder-82786 Feb 09 13:14:53.748982 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-7874488e-4212-4af4-8aaa-def9394fea43 req-fe85ac44-4912-44f8-a178-a47349c55865 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035254 Feb 09 13:14:53.750238 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 281/579] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:14:53.815801 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-4136991e-b579-4b81-aa38-bdcc87b41d7a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:53.816626 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-4136991e-b579-4b81-aa38-bdcc87b41d7a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:53.823656 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4136991e-b579-4b81-aa38-bdcc87b41d7a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:53.824202 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4136991e-b579-4b81-aa38-bdcc87b41d7a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:53.825838 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4136991e-b579-4b81-aa38-bdcc87b41d7a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:53.826505 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4136991e-b579-4b81-aa38-bdcc87b41d7a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:54.027742 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-4136991e-b579-4b81-aa38-bdcc87b41d7a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:54.037002 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-4136991e-b579-4b81-aa38-bdcc87b41d7a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:54.038801 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-4136991e-b579-4b81-aa38-bdcc87b41d7a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:54.040089 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-4136991e-b579-4b81-aa38-bdcc87b41d7a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1737 microversion: 2.20 time: 0.229335 Feb 09 13:14:54.040729 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 299/580] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:53 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1737 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:14:54.297484 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-2259e6f0-7ef7-442e-bc98-0f4a1a99e8c9 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:54.298213 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-2259e6f0-7ef7-442e-bc98-0f4a1a99e8c9 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:54.305529 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2259e6f0-7ef7-442e-bc98-0f4a1a99e8c9 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:54.306537 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2259e6f0-7ef7-442e-bc98-0f4a1a99e8c9 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:54.307355 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2259e6f0-7ef7-442e-bc98-0f4a1a99e8c9 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:54.307979 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2259e6f0-7ef7-442e-bc98-0f4a1a99e8c9 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:54.464706 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-2259e6f0-7ef7-442e-bc98-0f4a1a99e8c9 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:54.474206 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-2259e6f0-7ef7-442e-bc98-0f4a1a99e8c9 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1314 microversion: 2.1 time: 0.184898 Feb 09 13:14:54.475392 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 282/581] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:54 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:54.556090 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-1f4626f3-3263-4d90-aa6a-901bca911c70 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:54.558815 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-1f4626f3-3263-4d90-aa6a-901bca911c70 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:54.566766 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1f4626f3-3263-4d90-aa6a-901bca911c70 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:54.567950 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1f4626f3-3263-4d90-aa6a-901bca911c70 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:54.569406 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1f4626f3-3263-4d90-aa6a-901bca911c70 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:54.589276 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1f4626f3-3263-4d90-aa6a-901bca911c70 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:54.642193 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-e77318af-9b56-4fa5-b07a-c4375e7033d7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:54.650429 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-e77318af-9b56-4fa5-b07a-c4375e7033d7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:54.657446 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e77318af-9b56-4fa5-b07a-c4375e7033d7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:54.657898 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e77318af-9b56-4fa5-b07a-c4375e7033d7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:54.658733 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e77318af-9b56-4fa5-b07a-c4375e7033d7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:54.659173 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e77318af-9b56-4fa5-b07a-c4375e7033d7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:54.717392 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e77318af-9b56-4fa5-b07a-c4375e7033d7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:54.717852 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e77318af-9b56-4fa5-b07a-c4375e7033d7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:54.718326 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.objects.instance [None req-e77318af-9b56-4fa5-b07a-c4375e7033d7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lazy-loading 'fault' on Instance uuid 64e5b30a-480d-4d7a-9944-88956c5cb510 {{(pid=116749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:14:54.753979 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-1f4626f3-3263-4d90-aa6a-901bca911c70 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:54.762531 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-e77318af-9b56-4fa5-b07a-c4375e7033d7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:54.765630 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-1f4626f3-3263-4d90-aa6a-901bca911c70 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.213284 Feb 09 13:14:54.766335 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 300/582] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:54 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:54.780731 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-e77318af-9b56-4fa5-b07a-c4375e7033d7 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1308 microversion: 2.1 time: 0.144488 Feb 09 13:14:54.781513 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 283/583] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:54 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1308 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:55.060576 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-49650d75-bb2c-45e6-a475-c1dc1ca4bb5e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:55.061188 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-49650d75-bb2c-45e6-a475-c1dc1ca4bb5e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:55.067374 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-49650d75-bb2c-45e6-a475-c1dc1ca4bb5e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:55.067831 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-49650d75-bb2c-45e6-a475-c1dc1ca4bb5e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:55.068627 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-49650d75-bb2c-45e6-a475-c1dc1ca4bb5e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:55.069067 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-49650d75-bb2c-45e6-a475-c1dc1ca4bb5e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:55.230996 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-49650d75-bb2c-45e6-a475-c1dc1ca4bb5e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:55.239588 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-49650d75-bb2c-45e6-a475-c1dc1ca4bb5e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:55.241781 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-49650d75-bb2c-45e6-a475-c1dc1ca4bb5e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:55.243375 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-49650d75-bb2c-45e6-a475-c1dc1ca4bb5e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1737 microversion: 2.20 time: 0.187069 Feb 09 13:14:55.253786 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 301/584] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:55 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:55.496320 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-5944044b-e796-45bc-8931-af4d5dfe503f tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:55.497597 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-5944044b-e796-45bc-8931-af4d5dfe503f tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:55.504440 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5944044b-e796-45bc-8931-af4d5dfe503f tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:55.504912 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5944044b-e796-45bc-8931-af4d5dfe503f tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:55.505713 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5944044b-e796-45bc-8931-af4d5dfe503f tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:55.507555 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5944044b-e796-45bc-8931-af4d5dfe503f tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:55.678325 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-5944044b-e796-45bc-8931-af4d5dfe503f tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:55.687454 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-5944044b-e796-45bc-8931-af4d5dfe503f tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1314 microversion: 2.1 time: 0.196828 Feb 09 13:14:55.696119 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 284/585] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:55 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:55.783017 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-8440d765-4912-4f2b-a46e-6b13a0efe2f3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:55.783781 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-8440d765-4912-4f2b-a46e-6b13a0efe2f3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:55.791312 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8440d765-4912-4f2b-a46e-6b13a0efe2f3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:55.792140 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8440d765-4912-4f2b-a46e-6b13a0efe2f3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:55.792883 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8440d765-4912-4f2b-a46e-6b13a0efe2f3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:55.793545 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8440d765-4912-4f2b-a46e-6b13a0efe2f3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:55.796879 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-23320430-23db-4c53-9490-547e27afdc5a tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:55.797497 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-23320430-23db-4c53-9490-547e27afdc5a tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:55.806874 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-23320430-23db-4c53-9490-547e27afdc5a tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:55.807335 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-23320430-23db-4c53-9490-547e27afdc5a tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:55.810000 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-23320430-23db-4c53-9490-547e27afdc5a tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:55.810000 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-23320430-23db-4c53-9490-547e27afdc5a tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:55.858517 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-23320430-23db-4c53-9490-547e27afdc5a tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:55.859045 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-23320430-23db-4c53-9490-547e27afdc5a tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:55.859520 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.objects.instance [None req-23320430-23db-4c53-9490-547e27afdc5a tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lazy-loading 'fault' on Instance uuid 64e5b30a-480d-4d7a-9944-88956c5cb510 {{(pid=116749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:14:55.907232 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-23320430-23db-4c53-9490-547e27afdc5a tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:55.916025 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-23320430-23db-4c53-9490-547e27afdc5a tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1308 microversion: 2.1 time: 0.122108 Feb 09 13:14:55.925853 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 285/586] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:55 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1308 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:55.980019 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-8440d765-4912-4f2b-a46e-6b13a0efe2f3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:55.988200 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-8440d765-4912-4f2b-a46e-6b13a0efe2f3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.208614 Feb 09 13:14:55.988811 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 302/587] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:55 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:56.261080 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-49cb5fec-d262-48b7-a5e5-6fbb168340d9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:56.261696 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-49cb5fec-d262-48b7-a5e5-6fbb168340d9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:56.267819 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-49cb5fec-d262-48b7-a5e5-6fbb168340d9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:56.268283 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-49cb5fec-d262-48b7-a5e5-6fbb168340d9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:56.269073 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-49cb5fec-d262-48b7-a5e5-6fbb168340d9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:56.269552 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-49cb5fec-d262-48b7-a5e5-6fbb168340d9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:56.412864 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-49cb5fec-d262-48b7-a5e5-6fbb168340d9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:56.421016 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-49cb5fec-d262-48b7-a5e5-6fbb168340d9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:56.422538 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-49cb5fec-d262-48b7-a5e5-6fbb168340d9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:56.423697 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-49cb5fec-d262-48b7-a5e5-6fbb168340d9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1737 microversion: 2.20 time: 0.166350 Feb 09 13:14:56.424253 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 286/588] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:56 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:56.705555 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-3d321aba-735c-40b0-a2ca-2a102f92a668 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:56.706158 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-3d321aba-735c-40b0-a2ca-2a102f92a668 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:56.712608 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3d321aba-735c-40b0-a2ca-2a102f92a668 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:56.713062 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3d321aba-735c-40b0-a2ca-2a102f92a668 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:56.713840 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3d321aba-735c-40b0-a2ca-2a102f92a668 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:56.714278 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3d321aba-735c-40b0-a2ca-2a102f92a668 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:56.844173 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-3d321aba-735c-40b0-a2ca-2a102f92a668 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:56.851962 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-3d321aba-735c-40b0-a2ca-2a102f92a668 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1314 microversion: 2.1 time: 0.151225 Feb 09 13:14:56.852567 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 303/589] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:56 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:56.932153 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-00889165-ffda-4468-b240-4e507b516730 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:56.932803 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-00889165-ffda-4468-b240-4e507b516730 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:56.941096 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-00889165-ffda-4468-b240-4e507b516730 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:56.941096 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-00889165-ffda-4468-b240-4e507b516730 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:56.941096 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-00889165-ffda-4468-b240-4e507b516730 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:56.941096 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-00889165-ffda-4468-b240-4e507b516730 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:56.974171 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-00889165-ffda-4468-b240-4e507b516730 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:56.974527 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-00889165-ffda-4468-b240-4e507b516730 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:56.975003 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.objects.instance [None req-00889165-ffda-4468-b240-4e507b516730 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lazy-loading 'fault' on Instance uuid 64e5b30a-480d-4d7a-9944-88956c5cb510 {{(pid=116749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:14:57.008509 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-15d184da-cff5-4c9b-be8f-b791c2071921 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:57.009206 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-15d184da-cff5-4c9b-be8f-b791c2071921 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:57.016148 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-15d184da-cff5-4c9b-be8f-b791c2071921 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:57.016884 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-15d184da-cff5-4c9b-be8f-b791c2071921 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:57.018507 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-15d184da-cff5-4c9b-be8f-b791c2071921 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:57.019131 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-15d184da-cff5-4c9b-be8f-b791c2071921 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:57.027791 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-00889165-ffda-4468-b240-4e507b516730 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:57.036254 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-00889165-ffda-4468-b240-4e507b516730 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 200 len: 1308 microversion: 2.1 time: 0.107516 Feb 09 13:14:57.048101 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 287/590] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:56 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 1308 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:57.181132 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-15d184da-cff5-4c9b-be8f-b791c2071921 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:57.199394 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-15d184da-cff5-4c9b-be8f-b791c2071921 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.185836 Feb 09 13:14:57.200399 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 304/591] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:57 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:57.442064 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-71284df9-6dd8-437a-adf0-0e3ba7491667 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:57.443017 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-71284df9-6dd8-437a-adf0-0e3ba7491667 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:57.452403 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-71284df9-6dd8-437a-adf0-0e3ba7491667 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:57.453304 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-71284df9-6dd8-437a-adf0-0e3ba7491667 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:57.454350 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-71284df9-6dd8-437a-adf0-0e3ba7491667 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:57.455025 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-71284df9-6dd8-437a-adf0-0e3ba7491667 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:57.599341 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-71284df9-6dd8-437a-adf0-0e3ba7491667 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:57.610369 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-71284df9-6dd8-437a-adf0-0e3ba7491667 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:57.612211 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-71284df9-6dd8-437a-adf0-0e3ba7491667 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:57.613113 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-71284df9-6dd8-437a-adf0-0e3ba7491667 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1737 microversion: 2.20 time: 0.174909 Feb 09 13:14:57.622136 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 288/592] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:57 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:57.874578 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-1a82e69e-2e77-4cfa-858e-1d7ac85d818d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:57.875267 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-1a82e69e-2e77-4cfa-858e-1d7ac85d818d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:57.881453 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1a82e69e-2e77-4cfa-858e-1d7ac85d818d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:57.881932 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1a82e69e-2e77-4cfa-858e-1d7ac85d818d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:57.882947 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1a82e69e-2e77-4cfa-858e-1d7ac85d818d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:57.888791 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1a82e69e-2e77-4cfa-858e-1d7ac85d818d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:58.016379 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-1a82e69e-2e77-4cfa-858e-1d7ac85d818d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:58.023820 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-1a82e69e-2e77-4cfa-858e-1d7ac85d818d tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1314 microversion: 2.1 time: 0.152991 Feb 09 13:14:58.024408 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 305/593] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:57 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:58.054614 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c351146c-48ce-499b-b4c2-b2b1574fb3f8 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:58.055276 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-c351146c-48ce-499b-b4c2-b2b1574fb3f8 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 64e5b30a-480d-4d7a-9944-88956c5cb510] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:58.062457 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c351146c-48ce-499b-b4c2-b2b1574fb3f8 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:58.062951 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c351146c-48ce-499b-b4c2-b2b1574fb3f8 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:58.063751 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c351146c-48ce-499b-b4c2-b2b1574fb3f8 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:58.064190 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c351146c-48ce-499b-b4c2-b2b1574fb3f8 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:58.077187 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-c351146c-48ce-499b-b4c2-b2b1574fb3f8 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] HTTP exception thrown: Instance 64e5b30a-480d-4d7a-9944-88956c5cb510 could not be found. Feb 09 13:14:58.078028 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c351146c-48ce-499b-b4c2-b2b1574fb3f8 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Returning 404 to user: Instance 64e5b30a-480d-4d7a-9944-88956c5cb510 could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:14:58.078761 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c351146c-48ce-499b-b4c2-b2b1574fb3f8 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510" status: 404 len: 111 microversion: 2.1 time: 0.027823 Feb 09 13:14:58.079289 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 289/594] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:58 2022] GET /compute/v2.1/servers/64e5b30a-480d-4d7a-9944-88956c5cb510 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:14:58.087230 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-31b01118-50f9-41a1-bbdb-66e0f960cdb6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:58.087673 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-31b01118-50f9-41a1-bbdb-66e0f960cdb6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:58.093468 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-31b01118-50f9-41a1-bbdb-66e0f960cdb6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:58.093924 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-31b01118-50f9-41a1-bbdb-66e0f960cdb6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:58.094808 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-31b01118-50f9-41a1-bbdb-66e0f960cdb6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:58.095319 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-31b01118-50f9-41a1-bbdb-66e0f960cdb6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:58.120423 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-31b01118-50f9-41a1-bbdb-66e0f960cdb6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Going to try to terminate instance {{(pid=116748) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 09 13:14:58.215993 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-cf82cd2a-7004-4124-8295-de447fce2615 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:58.216639 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-cf82cd2a-7004-4124-8295-de447fce2615 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:58.222597 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-cf82cd2a-7004-4124-8295-de447fce2615 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:58.223082 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-cf82cd2a-7004-4124-8295-de447fce2615 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:58.223811 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-cf82cd2a-7004-4124-8295-de447fce2615 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:58.224254 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-cf82cd2a-7004-4124-8295-de447fce2615 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:58.355757 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-cf82cd2a-7004-4124-8295-de447fce2615 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:58.362985 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-cf82cd2a-7004-4124-8295-de447fce2615 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.151168 Feb 09 13:14:58.366846 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 290/595] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:58 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:14:58.463261 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-31b01118-50f9-41a1-bbdb-66e0f960cdb6 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "DELETE /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 204 len: 0 microversion: 2.1 time: 0.378860 Feb 09 13:14:58.463866 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 306/596] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:14:58 2022] DELETE /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 09 13:14:58.471874 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-a53eaf5e-f9e7-4d36-b584-8fad74d7a87b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:58.472494 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-a53eaf5e-f9e7-4d36-b584-8fad74d7a87b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:58.478215 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a53eaf5e-f9e7-4d36-b584-8fad74d7a87b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:58.479297 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a53eaf5e-f9e7-4d36-b584-8fad74d7a87b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:58.480091 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a53eaf5e-f9e7-4d36-b584-8fad74d7a87b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:58.480535 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a53eaf5e-f9e7-4d36-b584-8fad74d7a87b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:58.615795 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-a53eaf5e-f9e7-4d36-b584-8fad74d7a87b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:58.623248 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-a53eaf5e-f9e7-4d36-b584-8fad74d7a87b tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1513 microversion: 2.1 time: 0.155233 Feb 09 13:14:58.623812 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 291/597] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:58 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:58.636118 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-acedf805-ec3e-43fe-b8c5-67a2caf20066 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:58.636819 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-acedf805-ec3e-43fe-b8c5-67a2caf20066 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:58.642930 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-acedf805-ec3e-43fe-b8c5-67a2caf20066 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:58.643389 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-acedf805-ec3e-43fe-b8c5-67a2caf20066 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:58.644209 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-acedf805-ec3e-43fe-b8c5-67a2caf20066 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:58.644648 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-acedf805-ec3e-43fe-b8c5-67a2caf20066 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:58.778954 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-acedf805-ec3e-43fe-b8c5-67a2caf20066 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:58.786686 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-acedf805-ec3e-43fe-b8c5-67a2caf20066 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:58.788183 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-acedf805-ec3e-43fe-b8c5-67a2caf20066 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:58.789325 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-acedf805-ec3e-43fe-b8c5-67a2caf20066 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1737 microversion: 2.20 time: 0.157836 Feb 09 13:14:58.789914 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 307/598] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:58 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:14:59.040725 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-f6736e4d-880d-4f05-9037-9f4c0e313c35 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:59.041344 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-f6736e4d-880d-4f05-9037-9f4c0e313c35 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:59.050424 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f6736e4d-880d-4f05-9037-9f4c0e313c35 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:59.050916 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f6736e4d-880d-4f05-9037-9f4c0e313c35 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:59.051723 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f6736e4d-880d-4f05-9037-9f4c0e313c35 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:59.052173 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f6736e4d-880d-4f05-9037-9f4c0e313c35 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:59.187739 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-f6736e4d-880d-4f05-9037-9f4c0e313c35 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:59.195840 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-f6736e4d-880d-4f05-9037-9f4c0e313c35 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1314 microversion: 2.1 time: 0.158856 Feb 09 13:14:59.204171 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 292/599] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:59 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:59.381046 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-e3e4515b-4037-470d-8e18-c3a920ff9c05 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:59.381670 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-e3e4515b-4037-470d-8e18-c3a920ff9c05 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:59.389868 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e3e4515b-4037-470d-8e18-c3a920ff9c05 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:59.390525 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e3e4515b-4037-470d-8e18-c3a920ff9c05 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:59.391707 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e3e4515b-4037-470d-8e18-c3a920ff9c05 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:59.392329 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e3e4515b-4037-470d-8e18-c3a920ff9c05 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:59.395613 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-1c93619e-fa19-459f-afb2-b8a5e1a78182 req-5b845af4-7bd7-451f-8ca7-19d2097eadeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b56fd141-d0a7-42c4-a21f-fde932c567ad", "name": "network-vif-plugged", "status": "completed", "tag": "fd22a251-c76d-4b92-abb9-ba8c6ffd24ff"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:14:59.398693 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:14:59.398693 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:14:59.407069 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-1c93619e-fa19-459f-afb2-b8a5e1a78182 req-5b845af4-7bd7-451f-8ca7-19d2097eadeb service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:59.407792 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-1c93619e-fa19-459f-afb2-b8a5e1a78182 req-5b845af4-7bd7-451f-8ca7-19d2097eadeb service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:59.421937 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-1c93619e-fa19-459f-afb2-b8a5e1a78182 req-5b845af4-7bd7-451f-8ca7-19d2097eadeb service nova] Creating event network-vif-plugged:fd22a251-c76d-4b92-abb9-ba8c6ffd24ff for instance b56fd141-d0a7-42c4-a21f-fde932c567ad on hv-cinder-82786 Feb 09 13:14:59.427313 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-1c93619e-fa19-459f-afb2-b8a5e1a78182 req-5b845af4-7bd7-451f-8ca7-19d2097eadeb service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036434 Feb 09 13:14:59.427926 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 293/600] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:14:59.543572 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e3e4515b-4037-470d-8e18-c3a920ff9c05 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:59.551914 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-e3e4515b-4037-470d-8e18-c3a920ff9c05 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.176058 Feb 09 13:14:59.552770 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 308/601] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:59 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:14:59.643171 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-190753be-6ce1-45b4-aae8-4493086bf7b1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:59.643841 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-190753be-6ce1-45b4-aae8-4493086bf7b1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:59.650283 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-190753be-6ce1-45b4-aae8-4493086bf7b1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:59.651099 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-190753be-6ce1-45b4-aae8-4493086bf7b1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:59.651944 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-190753be-6ce1-45b4-aae8-4493086bf7b1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:59.652691 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-190753be-6ce1-45b4-aae8-4493086bf7b1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:59.807623 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-7dd62208-af02-4585-9f53-2a4df20d6792 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:14:59.808342 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-7dd62208-af02-4585-9f53-2a4df20d6792 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:14:59.814139 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7dd62208-af02-4585-9f53-2a4df20d6792 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:59.814720 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7dd62208-af02-4585-9f53-2a4df20d6792 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:59.815573 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7dd62208-af02-4585-9f53-2a4df20d6792 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:14:59.816077 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7dd62208-af02-4585-9f53-2a4df20d6792 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:14:59.953633 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-7dd62208-af02-4585-9f53-2a4df20d6792 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:59.958887 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-190753be-6ce1-45b4-aae8-4493086bf7b1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:59.961603 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-7dd62208-af02-4585-9f53-2a4df20d6792 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:59.963995 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-7dd62208-af02-4585-9f53-2a4df20d6792 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:14:59.964759 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-7dd62208-af02-4585-9f53-2a4df20d6792 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1719 microversion: 2.20 time: 0.161030 Feb 09 13:14:59.970611 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 309/602] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:14:59 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:14:59.974936 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-190753be-6ce1-45b4-aae8-4493086bf7b1 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1513 microversion: 2.1 time: 0.335384 Feb 09 13:14:59.975805 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 294/603] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:14:59 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1513 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:00.213777 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-1757b164-712f-427b-997d-c97b50ff9eb7 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:00.214387 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-1757b164-712f-427b-997d-c97b50ff9eb7 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:00.220214 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1757b164-712f-427b-997d-c97b50ff9eb7 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:00.220658 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1757b164-712f-427b-997d-c97b50ff9eb7 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:00.221479 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1757b164-712f-427b-997d-c97b50ff9eb7 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:00.221865 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1757b164-712f-427b-997d-c97b50ff9eb7 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:00.354581 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-1757b164-712f-427b-997d-c97b50ff9eb7 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:00.361973 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-1757b164-712f-427b-997d-c97b50ff9eb7 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1314 microversion: 2.1 time: 0.152539 Feb 09 13:15:00.362934 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 310/604] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:00 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:00.569287 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-4eff021d-378b-4281-8055-77a9d7fc1cc3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:00.569870 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-4eff021d-378b-4281-8055-77a9d7fc1cc3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:00.576665 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4eff021d-378b-4281-8055-77a9d7fc1cc3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:00.577053 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4eff021d-378b-4281-8055-77a9d7fc1cc3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:00.577839 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4eff021d-378b-4281-8055-77a9d7fc1cc3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:00.578269 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4eff021d-378b-4281-8055-77a9d7fc1cc3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:00.792880 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-4eff021d-378b-4281-8055-77a9d7fc1cc3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:00.800362 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-4eff021d-378b-4281-8055-77a9d7fc1cc3 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1520 microversion: 2.1 time: 0.234976 Feb 09 13:15:00.802152 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 295/605] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:00 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:00.911937 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-0cf0fc5a-b922-4919-a12d-fcea9d7c127e req-84eed047-f4ee-4b37-9588-32dbf6d5c1ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6851d5fe-b010-49cc-8696-19a1008c2beb", "name": "network-vif-deleted", "tag": "e603fae6-8816-4c72-bb3a-419850a3b7de"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:15:00.913636 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:15:00.913636 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:15:00.922015 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-0cf0fc5a-b922-4919-a12d-fcea9d7c127e req-84eed047-f4ee-4b37-9588-32dbf6d5c1ab service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:00.922457 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-0cf0fc5a-b922-4919-a12d-fcea9d7c127e req-84eed047-f4ee-4b37-9588-32dbf6d5c1ab service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:00.933925 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-0cf0fc5a-b922-4919-a12d-fcea9d7c127e req-84eed047-f4ee-4b37-9588-32dbf6d5c1ab service nova] Creating event network-vif-deleted:e603fae6-8816-4c72-bb3a-419850a3b7de for instance 6851d5fe-b010-49cc-8696-19a1008c2beb on hv-cinder-82786 Feb 09 13:15:00.938735 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-0cf0fc5a-b922-4919-a12d-fcea9d7c127e req-84eed047-f4ee-4b37-9588-32dbf6d5c1ab service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030591 Feb 09 13:15:00.939317 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 311/606] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:15:00.983965 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-85bd332a-bcfb-4d61-9e2a-dc7a46835fe2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:00.985193 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-85bd332a-bcfb-4d61-9e2a-dc7a46835fe2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:00.991570 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-85bd332a-bcfb-4d61-9e2a-dc7a46835fe2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:00.992026 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-85bd332a-bcfb-4d61-9e2a-dc7a46835fe2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:00.992449 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-f7427742-ddda-4ac1-94e8-ed2d4fa6c202 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:00.992907 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-85bd332a-bcfb-4d61-9e2a-dc7a46835fe2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:00.993356 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-f7427742-ddda-4ac1-94e8-ed2d4fa6c202 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:00.993501 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-85bd332a-bcfb-4d61-9e2a-dc7a46835fe2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:01.000410 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f7427742-ddda-4ac1-94e8-ed2d4fa6c202 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:01.000875 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f7427742-ddda-4ac1-94e8-ed2d4fa6c202 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:01.001771 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f7427742-ddda-4ac1-94e8-ed2d4fa6c202 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:01.002291 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f7427742-ddda-4ac1-94e8-ed2d4fa6c202 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:01.141454 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-85bd332a-bcfb-4d61-9e2a-dc7a46835fe2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:01.142259 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f7427742-ddda-4ac1-94e8-ed2d4fa6c202 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:01.149981 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-85bd332a-bcfb-4d61-9e2a-dc7a46835fe2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:01.151749 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-f7427742-ddda-4ac1-94e8-ed2d4fa6c202 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1513 microversion: 2.1 time: 0.163388 Feb 09 13:15:01.151864 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-85bd332a-bcfb-4d61-9e2a-dc7a46835fe2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:01.152493 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 312/607] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:00 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:15:01.153003 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-85bd332a-bcfb-4d61-9e2a-dc7a46835fe2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1719 microversion: 2.20 time: 0.172818 Feb 09 13:15:01.153555 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 296/608] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:00 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1719 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:15:01.379014 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-3931d466-96ff-42c7-af7d-1c81efda5e26 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:01.379552 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-3931d466-96ff-42c7-af7d-1c81efda5e26 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:01.385478 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3931d466-96ff-42c7-af7d-1c81efda5e26 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:01.386191 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3931d466-96ff-42c7-af7d-1c81efda5e26 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:01.386933 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3931d466-96ff-42c7-af7d-1c81efda5e26 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:01.387382 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3931d466-96ff-42c7-af7d-1c81efda5e26 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:01.534047 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-3931d466-96ff-42c7-af7d-1c81efda5e26 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:01.542156 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-3931d466-96ff-42c7-af7d-1c81efda5e26 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1314 microversion: 2.1 time: 0.166999 Feb 09 13:15:01.542890 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 313/609] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:01 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:01.817209 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d0098a6d-2126-40f9-8daa-589db035ce0b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:01.822693 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d0098a6d-2126-40f9-8daa-589db035ce0b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:01.830525 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d0098a6d-2126-40f9-8daa-589db035ce0b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:01.831016 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d0098a6d-2126-40f9-8daa-589db035ce0b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:01.832170 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d0098a6d-2126-40f9-8daa-589db035ce0b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:01.832950 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d0098a6d-2126-40f9-8daa-589db035ce0b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:01.866086 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d0098a6d-2126-40f9-8daa-589db035ce0b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:01.866528 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d0098a6d-2126-40f9-8daa-589db035ce0b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:01.866999 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.objects.instance [None req-d0098a6d-2126-40f9-8daa-589db035ce0b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lazy-loading 'fault' on Instance uuid 6851d5fe-b010-49cc-8696-19a1008c2beb {{(pid=116749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:15:01.910791 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-d0098a6d-2126-40f9-8daa-589db035ce0b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c97ae472fe4b318dc9cd02cfee6b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d2818a8454068b7397ceefa95ab7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:01.919078 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d0098a6d-2126-40f9-8daa-589db035ce0b tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 200 len: 1312 microversion: 2.1 time: 0.105497 Feb 09 13:15:01.925632 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 297/610] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:01 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:02.169856 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-9d1a2e85-7d39-448e-98bf-228137247249 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:02.170642 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-9d1a2e85-7d39-448e-98bf-228137247249 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:02.170820 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8897c367-97b5-46e5-af93-076062c81733 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:02.171403 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8897c367-97b5-46e5-af93-076062c81733 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:02.177354 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8897c367-97b5-46e5-af93-076062c81733 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:02.177540 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9d1a2e85-7d39-448e-98bf-228137247249 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:02.177807 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8897c367-97b5-46e5-af93-076062c81733 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:02.178088 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9d1a2e85-7d39-448e-98bf-228137247249 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:02.178636 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8897c367-97b5-46e5-af93-076062c81733 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:02.179095 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8897c367-97b5-46e5-af93-076062c81733 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:02.179363 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9d1a2e85-7d39-448e-98bf-228137247249 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:02.179963 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9d1a2e85-7d39-448e-98bf-228137247249 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:02.211388 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9d1a2e85-7d39-448e-98bf-228137247249 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:02.212007 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9d1a2e85-7d39-448e-98bf-228137247249 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:02.212471 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-9d1a2e85-7d39-448e-98bf-228137247249 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lazy-loading 'fault' on Instance uuid 74d73213-038a-446e-a171-6bf526f06626 {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:15:02.252321 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-9d1a2e85-7d39-448e-98bf-228137247249 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:02.261189 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-9d1a2e85-7d39-448e-98bf-228137247249 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 200 len: 1308 microversion: 2.1 time: 0.097513 Feb 09 13:15:02.262053 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 314/611] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:02 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:15:02.320061 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8897c367-97b5-46e5-af93-076062c81733 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:02.328557 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8897c367-97b5-46e5-af93-076062c81733 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:02.330053 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8897c367-97b5-46e5-af93-076062c81733 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:02.331227 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8897c367-97b5-46e5-af93-076062c81733 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1719 microversion: 2.20 time: 0.164898 Feb 09 13:15:02.331786 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 298/612] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:02 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:15:02.558953 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-f1892e38-94c8-4fab-a4f3-03e5c5849883 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:02.559703 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-f1892e38-94c8-4fab-a4f3-03e5c5849883 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:02.565794 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f1892e38-94c8-4fab-a4f3-03e5c5849883 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:02.566255 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f1892e38-94c8-4fab-a4f3-03e5c5849883 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:02.567113 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f1892e38-94c8-4fab-a4f3-03e5c5849883 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:02.567679 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f1892e38-94c8-4fab-a4f3-03e5c5849883 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:02.705374 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f1892e38-94c8-4fab-a4f3-03e5c5849883 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:02.712915 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-f1892e38-94c8-4fab-a4f3-03e5c5849883 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1463 microversion: 2.1 time: 0.157783 Feb 09 13:15:02.713676 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 315/613] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:02 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1463 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:02.757514 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-f38c5373-1b34-4406-821f-50d0e4bd8fcd tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:02.758021 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-f38c5373-1b34-4406-821f-50d0e4bd8fcd tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:02.764652 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f38c5373-1b34-4406-821f-50d0e4bd8fcd tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:02.765106 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f38c5373-1b34-4406-821f-50d0e4bd8fcd tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:02.765896 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f38c5373-1b34-4406-821f-50d0e4bd8fcd tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:02.766339 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f38c5373-1b34-4406-821f-50d0e4bd8fcd tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:02.790814 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-f38c5373-1b34-4406-821f-50d0e4bd8fcd tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Going to try to terminate instance {{(pid=116749) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 09 13:15:02.937659 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-67052bf3-4286-445a-9764-6a1575435b72 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:02.938183 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-67052bf3-4286-445a-9764-6a1575435b72 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] [instance: 6851d5fe-b010-49cc-8696-19a1008c2beb] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:02.943994 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-67052bf3-4286-445a-9764-6a1575435b72 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:02.944443 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-67052bf3-4286-445a-9764-6a1575435b72 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:02.945219 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-67052bf3-4286-445a-9764-6a1575435b72 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:02.945956 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-67052bf3-4286-445a-9764-6a1575435b72 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:02.959734 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.wsgi [None req-67052bf3-4286-445a-9764-6a1575435b72 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] HTTP exception thrown: Instance 6851d5fe-b010-49cc-8696-19a1008c2beb could not be found. Feb 09 13:15:02.960327 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-67052bf3-4286-445a-9764-6a1575435b72 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] Returning 404 to user: Instance 6851d5fe-b010-49cc-8696-19a1008c2beb could not be found. {{(pid=116748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:15:02.961142 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-67052bf3-4286-445a-9764-6a1575435b72 tempest-ServerRescueNegativeTestJSON-207313834 tempest-ServerRescueNegativeTestJSON-207313834-project] 10.222.0.84 "GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb" status: 404 len: 111 microversion: 2.1 time: 0.027366 Feb 09 13:15:02.962171 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 316/614] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:02 2022] GET /compute/v2.1/servers/6851d5fe-b010-49cc-8696-19a1008c2beb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 09 13:15:02.968359 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-d95a096d-0986-4cc1-b995-3f67fede95ef req-31a94ab7-da4c-4d8c-bc72-2476e5dc0aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d73213-038a-446e-a171-6bf526f06626", "name": "network-vif-deleted", "tag": "84c81437-1fbd-4c50-87de-41f47b4410a0"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:15:02.970041 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:15:02.970041 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:15:02.976912 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-d95a096d-0986-4cc1-b995-3f67fede95ef req-31a94ab7-da4c-4d8c-bc72-2476e5dc0aa6 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:02.977383 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-d95a096d-0986-4cc1-b995-3f67fede95ef req-31a94ab7-da4c-4d8c-bc72-2476e5dc0aa6 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:02.987874 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-d95a096d-0986-4cc1-b995-3f67fede95ef req-31a94ab7-da4c-4d8c-bc72-2476e5dc0aa6 service nova] Creating event network-vif-deleted:84c81437-1fbd-4c50-87de-41f47b4410a0 for instance 74d73213-038a-446e-a171-6bf526f06626 on hv-cinder-82786 Feb 09 13:15:02.992700 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-d95a096d-0986-4cc1-b995-3f67fede95ef req-31a94ab7-da4c-4d8c-bc72-2476e5dc0aa6 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029933 Feb 09 13:15:02.994546 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 317/615] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:15:03.153907 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-f38c5373-1b34-4406-821f-50d0e4bd8fcd tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "DELETE /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 204 len: 0 microversion: 2.1 time: 0.401699 Feb 09 13:15:03.154772 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 299/616] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:15:02 2022] DELETE /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 09 13:15:03.163563 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-c56f6215-d738-4911-b524-64274e5ca3c1 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:03.164299 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-c56f6215-d738-4911-b524-64274e5ca3c1 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:03.171716 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c56f6215-d738-4911-b524-64274e5ca3c1 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:03.172336 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c56f6215-d738-4911-b524-64274e5ca3c1 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:03.173623 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c56f6215-d738-4911-b524-64274e5ca3c1 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:03.173623 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c56f6215-d738-4911-b524-64274e5ca3c1 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:03.278169 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-2dbcdd82-9fe3-439c-8319-69b5382312ae tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:03.278888 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-2dbcdd82-9fe3-439c-8319-69b5382312ae tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 74d73213-038a-446e-a171-6bf526f06626] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:03.284960 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2dbcdd82-9fe3-439c-8319-69b5382312ae tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:03.285406 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2dbcdd82-9fe3-439c-8319-69b5382312ae tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:03.286191 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2dbcdd82-9fe3-439c-8319-69b5382312ae tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:03.286647 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2dbcdd82-9fe3-439c-8319-69b5382312ae tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:03.300849 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-2dbcdd82-9fe3-439c-8319-69b5382312ae tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] HTTP exception thrown: Instance 74d73213-038a-446e-a171-6bf526f06626 could not be found. Feb 09 13:15:03.301686 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-2dbcdd82-9fe3-439c-8319-69b5382312ae tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Returning 404 to user: Instance 74d73213-038a-446e-a171-6bf526f06626 could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:15:03.302604 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-2dbcdd82-9fe3-439c-8319-69b5382312ae tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626" status: 404 len: 111 microversion: 2.1 time: 0.028695 Feb 09 13:15:03.303156 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 300/617] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:03 2022] GET /compute/v2.1/servers/74d73213-038a-446e-a171-6bf526f06626 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 09 13:15:03.317996 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-c56f6215-d738-4911-b524-64274e5ca3c1 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:03.326086 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-c56f6215-d738-4911-b524-64274e5ca3c1 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1469 microversion: 2.1 time: 0.166827 Feb 09 13:15:03.329706 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 318/618] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:03 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1469 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:03.348954 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-940368b7-66a0-4f96-8152-c46c741d9b7c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:03.349591 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-940368b7-66a0-4f96-8152-c46c741d9b7c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:03.356064 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-940368b7-66a0-4f96-8152-c46c741d9b7c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:03.356743 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-940368b7-66a0-4f96-8152-c46c741d9b7c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:03.357285 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-940368b7-66a0-4f96-8152-c46c741d9b7c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:03.357724 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-940368b7-66a0-4f96-8152-c46c741d9b7c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:03.581001 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-940368b7-66a0-4f96-8152-c46c741d9b7c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:03.589402 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-940368b7-66a0-4f96-8152-c46c741d9b7c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:03.590949 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-940368b7-66a0-4f96-8152-c46c741d9b7c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:03.592194 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-940368b7-66a0-4f96-8152-c46c741d9b7c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1722 microversion: 2.20 time: 0.246919 Feb 09 13:15:03.592761 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 301/619] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:03 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:15:03.610060 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-7c1a4a1a-18f7-42b5-be88-e63a011ac771 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e11e3e3-d56a-48e8-be5f-4280fbeede12"}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:15:03.611220 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-7c1a4a1a-18f7-42b5-be88-e63a011ac771 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:03.627618 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7c1a4a1a-18f7-42b5-be88-e63a011ac771 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:03.627618 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7c1a4a1a-18f7-42b5-be88-e63a011ac771 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:03.627618 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7c1a4a1a-18f7-42b5-be88-e63a011ac771 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:03.627618 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7c1a4a1a-18f7-42b5-be88-e63a011ac771 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:04.346182 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-88391836-d28f-4c79-871a-43906a72935f tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:04.346882 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-88391836-d28f-4c79-871a-43906a72935f tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:04.353078 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-88391836-d28f-4c79-871a-43906a72935f tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:04.353578 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-88391836-d28f-4c79-871a-43906a72935f tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:04.354359 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-88391836-d28f-4c79-871a-43906a72935f tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:04.354841 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-88391836-d28f-4c79-871a-43906a72935f tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:04.639269 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-88391836-d28f-4c79-871a-43906a72935f tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:04.650692 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-88391836-d28f-4c79-871a-43906a72935f tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1469 microversion: 2.1 time: 0.307786 Feb 09 13:15:04.651543 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 302/620] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:04 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1469 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:15:05.049806 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-040e2e6b-1808-4098-9952-9ab985f581eb req-797cae54-6090-467d-931e-47a8f22d5324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267a95df-7ddb-4e9c-a629-4fc26b9c9843", "name": "network-vif-unplugged", "status": "completed", "tag": "45e332d3-92b6-4aa9-9b18-a8fa5ca22e31"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:15:05.052792 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:15:05.052792 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:15:05.064839 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-040e2e6b-1808-4098-9952-9ab985f581eb req-797cae54-6090-467d-931e-47a8f22d5324 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:05.065537 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-040e2e6b-1808-4098-9952-9ab985f581eb req-797cae54-6090-467d-931e-47a8f22d5324 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:05.068205 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-7c1a4a1a-18f7-42b5-be88-e63a011ac771 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "POST /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.462621 Feb 09 13:15:05.070579 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 319/621] 10.222.0.84 () {62 vars in 1363 bytes} [Wed Feb 9 13:15:03 2022] POST /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843/os-volume_attachments => generated 188 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 09 13:15:05.084949 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-040e2e6b-1808-4098-9952-9ab985f581eb req-797cae54-6090-467d-931e-47a8f22d5324 service nova] Creating event network-vif-unplugged:45e332d3-92b6-4aa9-9b18-a8fa5ca22e31 for instance 267a95df-7ddb-4e9c-a629-4fc26b9c9843 on hv-cinder-82786 Feb 09 13:15:05.091428 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-040e2e6b-1808-4098-9952-9ab985f581eb req-797cae54-6090-467d-931e-47a8f22d5324 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047098 Feb 09 13:15:05.092496 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 303/622] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:15:05.192640 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-c29cfb9b-af47-4a2e-bb8b-115e61298c5c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:15:05.193333 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-c29cfb9b-af47-4a2e-bb8b-115e61298c5c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:05.199472 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c29cfb9b-af47-4a2e-bb8b-115e61298c5c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:05.200051 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c29cfb9b-af47-4a2e-bb8b-115e61298c5c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:05.200956 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c29cfb9b-af47-4a2e-bb8b-115e61298c5c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:05.201494 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c29cfb9b-af47-4a2e-bb8b-115e61298c5c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:05.559111 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-c29cfb9b-af47-4a2e-bb8b-115e61298c5c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "POST /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843/action" status: 202 len: 0 microversion: 2.20 time: 0.370077 Feb 09 13:15:05.561309 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 320/623] 10.222.0.84 () {62 vars in 1318 bytes} [Wed Feb 9 13:15:05 2022] POST /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 09 13:15:05.570341 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-7402806d-8c30-4316-a506-f2f6564aa497 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:05.571066 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-7402806d-8c30-4316-a506-f2f6564aa497 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:05.585677 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7402806d-8c30-4316-a506-f2f6564aa497 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:05.585677 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7402806d-8c30-4316-a506-f2f6564aa497 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:05.585677 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7402806d-8c30-4316-a506-f2f6564aa497 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:05.585677 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7402806d-8c30-4316-a506-f2f6564aa497 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:05.673557 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-47049625-14e4-49fc-8cb4-9e91812dbef5 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:05.673557 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-47049625-14e4-49fc-8cb4-9e91812dbef5 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:05.674478 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-47049625-14e4-49fc-8cb4-9e91812dbef5 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:05.675005 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-47049625-14e4-49fc-8cb4-9e91812dbef5 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:05.675837 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-47049625-14e4-49fc-8cb4-9e91812dbef5 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:05.676275 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-47049625-14e4-49fc-8cb4-9e91812dbef5 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:05.855587 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-47049625-14e4-49fc-8cb4-9e91812dbef5 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:05.863735 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-47049625-14e4-49fc-8cb4-9e91812dbef5 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1469 microversion: 2.1 time: 0.200029 Feb 09 13:15:05.865537 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 321/624] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:05 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1469 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:06.020401 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-7402806d-8c30-4316-a506-f2f6564aa497 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:06.029463 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-7402806d-8c30-4316-a506-f2f6564aa497 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:06.030982 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-7402806d-8c30-4316-a506-f2f6564aa497 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:06.032134 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-7402806d-8c30-4316-a506-f2f6564aa497 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1808 microversion: 2.20 time: 0.466450 Feb 09 13:15:06.032722 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 304/625] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:05 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1808 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:15:06.701352 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-8accdc35-4a6f-4509-a87e-654aee12693e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:06.701855 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-8accdc35-4a6f-4509-a87e-654aee12693e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:06.709068 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8accdc35-4a6f-4509-a87e-654aee12693e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:06.713233 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8accdc35-4a6f-4509-a87e-654aee12693e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:06.716367 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8accdc35-4a6f-4509-a87e-654aee12693e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:06.717046 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8accdc35-4a6f-4509-a87e-654aee12693e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:06.769258 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-8accdc35-4a6f-4509-a87e-654aee12693e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Going to try to terminate instance {{(pid=116748) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 09 13:15:06.882592 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-3b901a6d-5cd5-475b-8448-599483d8c06b tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:06.883970 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-3b901a6d-5cd5-475b-8448-599483d8c06b tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:06.890999 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3b901a6d-5cd5-475b-8448-599483d8c06b tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:06.891497 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3b901a6d-5cd5-475b-8448-599483d8c06b tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:06.892347 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3b901a6d-5cd5-475b-8448-599483d8c06b tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:06.892730 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3b901a6d-5cd5-475b-8448-599483d8c06b tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:07.031809 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3b901a6d-5cd5-475b-8448-599483d8c06b tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:07.050156 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-3b901a6d-5cd5-475b-8448-599483d8c06b tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1469 microversion: 2.1 time: 0.169609 Feb 09 13:15:07.057682 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 305/626] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:06 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1469 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:15:07.065074 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-7c30d8ea-94fd-4b52-9821-2645800446e2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:07.066006 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-7c30d8ea-94fd-4b52-9821-2645800446e2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:07.074776 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7c30d8ea-94fd-4b52-9821-2645800446e2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:07.075230 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7c30d8ea-94fd-4b52-9821-2645800446e2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:07.076262 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7c30d8ea-94fd-4b52-9821-2645800446e2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:07.077156 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7c30d8ea-94fd-4b52-9821-2645800446e2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:07.217507 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-8accdc35-4a6f-4509-a87e-654aee12693e tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "DELETE /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 204 len: 0 microversion: 2.1 time: 0.521056 Feb 09 13:15:07.218127 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 322/627] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:15:06 2022] DELETE /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 09 13:15:07.227314 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-f4af3285-923f-415a-877a-a4a63e701075 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:07.237792 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-f4af3285-923f-415a-877a-a4a63e701075 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:07.238781 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-7c30d8ea-94fd-4b52-9821-2645800446e2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:07.239122 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f4af3285-923f-415a-877a-a4a63e701075 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:07.239122 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f4af3285-923f-415a-877a-a4a63e701075 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:07.239122 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f4af3285-923f-415a-877a-a4a63e701075 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:07.239122 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f4af3285-923f-415a-877a-a4a63e701075 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:07.244615 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-7c30d8ea-94fd-4b52-9821-2645800446e2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:07.246647 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-7c30d8ea-94fd-4b52-9821-2645800446e2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:07.247818 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-7c30d8ea-94fd-4b52-9821-2645800446e2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1748 microversion: 2.20 time: 0.189140 Feb 09 13:15:07.258602 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 306/628] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:07 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1748 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:15:07.378894 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f4af3285-923f-415a-877a-a4a63e701075 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:07.387023 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-f4af3285-923f-415a-877a-a4a63e701075 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1512 microversion: 2.1 time: 0.164171 Feb 09 13:15:07.387602 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 323/629] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:07 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:07.949640 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-e1075dca-ed5e-42fa-a229-2d0ec490f04d req-bb512b3c-7326-4480-b076-612d64b67da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b56fd141-d0a7-42c4-a21f-fde932c567ad", "name": "network-vif-deleted", "tag": "fd22a251-c76d-4b92-abb9-ba8c6ffd24ff"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:15:07.951339 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:15:07.951339 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:15:07.958517 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-e1075dca-ed5e-42fa-a229-2d0ec490f04d req-bb512b3c-7326-4480-b076-612d64b67da4 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:07.959005 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-e1075dca-ed5e-42fa-a229-2d0ec490f04d req-bb512b3c-7326-4480-b076-612d64b67da4 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:07.974873 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-e1075dca-ed5e-42fa-a229-2d0ec490f04d req-bb512b3c-7326-4480-b076-612d64b67da4 service nova] Creating event network-vif-deleted:fd22a251-c76d-4b92-abb9-ba8c6ffd24ff for instance b56fd141-d0a7-42c4-a21f-fde932c567ad on hv-cinder-82786 Feb 09 13:15:07.980258 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-e1075dca-ed5e-42fa-a229-2d0ec490f04d req-bb512b3c-7326-4480-b076-612d64b67da4 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034320 Feb 09 13:15:07.980855 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 307/630] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:15:08.069157 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d2d8bf13-b078-42e7-a346-58b04bb15a59 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:08.069778 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d2d8bf13-b078-42e7-a346-58b04bb15a59 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:08.077381 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d2d8bf13-b078-42e7-a346-58b04bb15a59 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:08.078539 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d2d8bf13-b078-42e7-a346-58b04bb15a59 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:08.079532 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d2d8bf13-b078-42e7-a346-58b04bb15a59 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:08.080152 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d2d8bf13-b078-42e7-a346-58b04bb15a59 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:08.158698 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d2d8bf13-b078-42e7-a346-58b04bb15a59 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30762c3987d84d1cbef38befef535d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834752705fcb4325a3852c8b613c394f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:08.167925 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d2d8bf13-b078-42e7-a346-58b04bb15a59 tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 200 len: 1427 microversion: 2.1 time: 0.102769 Feb 09 13:15:08.168673 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 324/631] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:08 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:08.270728 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8b543642-7b08-4a36-8282-10f3e0e5aa2b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:08.271428 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8b543642-7b08-4a36-8282-10f3e0e5aa2b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:08.278169 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8b543642-7b08-4a36-8282-10f3e0e5aa2b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:08.278664 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8b543642-7b08-4a36-8282-10f3e0e5aa2b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:08.279442 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8b543642-7b08-4a36-8282-10f3e0e5aa2b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:08.279885 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8b543642-7b08-4a36-8282-10f3e0e5aa2b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:08.404559 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-49e3957e-4f92-4e21-8f30-d9de20e78549 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:08.405091 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-49e3957e-4f92-4e21-8f30-d9de20e78549 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:08.410885 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-49e3957e-4f92-4e21-8f30-d9de20e78549 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:08.411337 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-49e3957e-4f92-4e21-8f30-d9de20e78549 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:08.412131 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-49e3957e-4f92-4e21-8f30-d9de20e78549 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:08.412570 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-49e3957e-4f92-4e21-8f30-d9de20e78549 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:08.419511 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8b543642-7b08-4a36-8282-10f3e0e5aa2b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:08.428355 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8b543642-7b08-4a36-8282-10f3e0e5aa2b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:08.429867 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8b543642-7b08-4a36-8282-10f3e0e5aa2b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:08.431084 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8b543642-7b08-4a36-8282-10f3e0e5aa2b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1750 microversion: 2.20 time: 0.164615 Feb 09 13:15:08.431736 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 308/632] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:08 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:15:08.574964 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-49e3957e-4f92-4e21-8f30-d9de20e78549 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:08.582583 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-49e3957e-4f92-4e21-8f30-d9de20e78549 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1512 microversion: 2.1 time: 0.182647 Feb 09 13:15:08.583189 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 325/633] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:08 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1512 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:09.188963 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-f9f6ca96-a455-43ce-93d1-5391d792940a tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:09.190131 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-f9f6ca96-a455-43ce-93d1-5391d792940a tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] [instance: b56fd141-d0a7-42c4-a21f-fde932c567ad] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:09.199118 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f9f6ca96-a455-43ce-93d1-5391d792940a tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:09.199118 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f9f6ca96-a455-43ce-93d1-5391d792940a tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:09.199118 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f9f6ca96-a455-43ce-93d1-5391d792940a tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:09.199118 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f9f6ca96-a455-43ce-93d1-5391d792940a tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:09.224224 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-f9f6ca96-a455-43ce-93d1-5391d792940a tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] HTTP exception thrown: Instance b56fd141-d0a7-42c4-a21f-fde932c567ad could not be found. Feb 09 13:15:09.224847 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-f9f6ca96-a455-43ce-93d1-5391d792940a tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] Returning 404 to user: Instance b56fd141-d0a7-42c4-a21f-fde932c567ad could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:15:09.225682 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-f9f6ca96-a455-43ce-93d1-5391d792940a tempest-VolumesNegativeTest-1603884084 tempest-VolumesNegativeTest-1603884084-project] 10.222.0.84 "GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad" status: 404 len: 111 microversion: 2.1 time: 0.040410 Feb 09 13:15:09.226245 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 309/634] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:09 2022] GET /compute/v2.1/servers/b56fd141-d0a7-42c4-a21f-fde932c567ad => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:15:09.452184 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-de5398ab-7346-4a68-b70d-020844ac4f09 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:09.452805 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-de5398ab-7346-4a68-b70d-020844ac4f09 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:09.461953 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-de5398ab-7346-4a68-b70d-020844ac4f09 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:09.466335 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-de5398ab-7346-4a68-b70d-020844ac4f09 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:09.467228 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-de5398ab-7346-4a68-b70d-020844ac4f09 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:09.467683 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-de5398ab-7346-4a68-b70d-020844ac4f09 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:09.600208 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-430778d9-daff-410a-acb5-33e44c2b1d97 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:09.600856 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-430778d9-daff-410a-acb5-33e44c2b1d97 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:09.607311 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-430778d9-daff-410a-acb5-33e44c2b1d97 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:09.607994 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-430778d9-daff-410a-acb5-33e44c2b1d97 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:09.608983 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-430778d9-daff-410a-acb5-33e44c2b1d97 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:09.609578 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-430778d9-daff-410a-acb5-33e44c2b1d97 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:09.651312 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-de5398ab-7346-4a68-b70d-020844ac4f09 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:09.660950 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-de5398ab-7346-4a68-b70d-020844ac4f09 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:09.662650 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-de5398ab-7346-4a68-b70d-020844ac4f09 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:09.664165 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-de5398ab-7346-4a68-b70d-020844ac4f09 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.216957 Feb 09 13:15:09.664735 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 326/635] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:09 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:15:09.678020 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-430778d9-daff-410a-acb5-33e44c2b1d97 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:09.685237 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-430778d9-daff-410a-acb5-33e44c2b1d97 tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1470 microversion: 2.1 time: 0.088855 Feb 09 13:15:09.685829 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 310/636] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:09 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1470 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:10.024336 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-7bbd837f-1882-4ba5-b44c-9834f1672c9d req-f385e19e-ba6d-4884-b57a-2bee95f49751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894904de-6d54-4785-b905-4a1901d9d87f", "name": "network-vif-deleted", "tag": "0c7a08f1-289e-49bd-b9bc-e830edeaee6f"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:15:10.026926 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:15:10.026926 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:15:10.033637 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-7bbd837f-1882-4ba5-b44c-9834f1672c9d req-f385e19e-ba6d-4884-b57a-2bee95f49751 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:10.034077 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-7bbd837f-1882-4ba5-b44c-9834f1672c9d req-f385e19e-ba6d-4884-b57a-2bee95f49751 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:10.044942 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-7bbd837f-1882-4ba5-b44c-9834f1672c9d req-f385e19e-ba6d-4884-b57a-2bee95f49751 service nova] Creating event network-vif-deleted:0c7a08f1-289e-49bd-b9bc-e830edeaee6f for instance 894904de-6d54-4785-b905-4a1901d9d87f on hv-cinder-82786 Feb 09 13:15:10.050417 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-7bbd837f-1882-4ba5-b44c-9834f1672c9d req-f385e19e-ba6d-4884-b57a-2bee95f49751 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029191 Feb 09 13:15:10.051172 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 327/637] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:15:10.685377 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-51065b11-46c8-4ae9-88b1-f9bd1374f74c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:10.686749 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-51065b11-46c8-4ae9-88b1-f9bd1374f74c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:10.693262 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-51065b11-46c8-4ae9-88b1-f9bd1374f74c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:10.694344 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-51065b11-46c8-4ae9-88b1-f9bd1374f74c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:10.695792 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-51065b11-46c8-4ae9-88b1-f9bd1374f74c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:10.699062 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-51065b11-46c8-4ae9-88b1-f9bd1374f74c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:10.703508 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-84891227-76e0-48c1-84ad-cb01bd22843d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:10.704804 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-84891227-76e0-48c1-84ad-cb01bd22843d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:10.712335 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-84891227-76e0-48c1-84ad-cb01bd22843d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:10.713916 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-84891227-76e0-48c1-84ad-cb01bd22843d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:10.715059 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-84891227-76e0-48c1-84ad-cb01bd22843d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:10.716426 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-84891227-76e0-48c1-84ad-cb01bd22843d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:10.758409 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-84891227-76e0-48c1-84ad-cb01bd22843d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:10.758972 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-84891227-76e0-48c1-84ad-cb01bd22843d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:10.760614 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-84891227-76e0-48c1-84ad-cb01bd22843d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lazy-loading 'fault' on Instance uuid 894904de-6d54-4785-b905-4a1901d9d87f {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:15:10.821466 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-84891227-76e0-48c1-84ad-cb01bd22843d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ee736e50d340be8da8586ee48fc7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e498b288c5455ea4e270d16d92dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:10.831188 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-84891227-76e0-48c1-84ad-cb01bd22843d tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 200 len: 1307 microversion: 2.1 time: 0.132146 Feb 09 13:15:10.831382 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 328/638] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:10 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 1307 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:15:10.893723 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-51065b11-46c8-4ae9-88b1-f9bd1374f74c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:10.911715 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-51065b11-46c8-4ae9-88b1-f9bd1374f74c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:10.927879 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-51065b11-46c8-4ae9-88b1-f9bd1374f74c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:10.927879 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-51065b11-46c8-4ae9-88b1-f9bd1374f74c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.234598 Feb 09 13:15:10.927879 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 311/639] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:10 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:15:11.438895 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-203589a9-ec2f-4804-affa-e38fd729a1c8 tempest-VolumesTestJSON-1561793938 tempest-VolumesTestJSON-1561793938-project] Calling method '.version_select at 0x7f7f648ebc10>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:11.493921 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-203589a9-ec2f-4804-affa-e38fd729a1c8 tempest-VolumesTestJSON-1561793938 tempest-VolumesTestJSON-1561793938-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/0668ac40-3fed-4a73-86b0-b877196441c8" status: 200 len: 351 microversion: 2.1 time: 0.059211 Feb 09 13:15:11.494876 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 329/640] 10.222.0.84 () {58 vars in 1244 bytes} [Wed Feb 9 13:15:11 2022] GET /compute/v2.1/os-volumes/0668ac40-3fed-4a73-86b0-b877196441c8 => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:15:11.857453 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-254f07ac-18e4-4ddb-9d10-b97ad2da0eec tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:11.858132 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-254f07ac-18e4-4ddb-9d10-b97ad2da0eec tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] [instance: 894904de-6d54-4785-b905-4a1901d9d87f] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:11.869966 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-254f07ac-18e4-4ddb-9d10-b97ad2da0eec tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:11.870641 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-254f07ac-18e4-4ddb-9d10-b97ad2da0eec tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:11.871432 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-254f07ac-18e4-4ddb-9d10-b97ad2da0eec tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:11.871875 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-254f07ac-18e4-4ddb-9d10-b97ad2da0eec tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:11.887398 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-254f07ac-18e4-4ddb-9d10-b97ad2da0eec tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] HTTP exception thrown: Instance 894904de-6d54-4785-b905-4a1901d9d87f could not be found. Feb 09 13:15:11.888254 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-254f07ac-18e4-4ddb-9d10-b97ad2da0eec tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] Returning 404 to user: Instance 894904de-6d54-4785-b905-4a1901d9d87f could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:15:11.889320 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-254f07ac-18e4-4ddb-9d10-b97ad2da0eec tempest-AttachVolumeNegativeTest-1252802114 tempest-AttachVolumeNegativeTest-1252802114-project] 10.222.0.84 "GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f" status: 404 len: 111 microversion: 2.1 time: 0.035633 Feb 09 13:15:11.890183 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 312/641] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:11 2022] GET /compute/v2.1/servers/894904de-6d54-4785-b905-4a1901d9d87f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:15:11.937012 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-ded11f55-de84-43a6-b815-39ec53b0b2be tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:11.937750 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-ded11f55-de84-43a6-b815-39ec53b0b2be tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:11.946078 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ded11f55-de84-43a6-b815-39ec53b0b2be tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:11.947841 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ded11f55-de84-43a6-b815-39ec53b0b2be tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:11.949812 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ded11f55-de84-43a6-b815-39ec53b0b2be tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:11.950710 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ded11f55-de84-43a6-b815-39ec53b0b2be tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:12.226861 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ded11f55-de84-43a6-b815-39ec53b0b2be tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:12.238967 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ded11f55-de84-43a6-b815-39ec53b0b2be tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:12.240689 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ded11f55-de84-43a6-b815-39ec53b0b2be tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:12.241901 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-ded11f55-de84-43a6-b815-39ec53b0b2be tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.309624 Feb 09 13:15:12.242998 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 330/642] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:11 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:15:13.365623 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-3c94dd4d-10ba-470f-acb3-e644b5687d41 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:13.365623 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-3c94dd4d-10ba-470f-acb3-e644b5687d41 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:13.365623 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3c94dd4d-10ba-470f-acb3-e644b5687d41 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:13.365623 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3c94dd4d-10ba-470f-acb3-e644b5687d41 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:13.367338 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3c94dd4d-10ba-470f-acb3-e644b5687d41 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:13.367338 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3c94dd4d-10ba-470f-acb3-e644b5687d41 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:13.442446 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3c94dd4d-10ba-470f-acb3-e644b5687d41 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:13.452173 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3c94dd4d-10ba-470f-acb3-e644b5687d41 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:13.454100 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3c94dd4d-10ba-470f-acb3-e644b5687d41 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:13.455453 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-3c94dd4d-10ba-470f-acb3-e644b5687d41 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.196443 Feb 09 13:15:13.456364 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 313/643] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:13 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:15:14.438882 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-c6868623-0a1e-4175-904e-aceb1493c9ed tempest-VolumesTestJSON-1561793938 tempest-VolumesTestJSON-1561793938-project] Calling method '.version_select at 0x7f7f645c9940>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:14.475188 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-95e51547-0cef-4f23-b93f-a305066a55fd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:14.476437 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-95e51547-0cef-4f23-b93f-a305066a55fd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:14.486474 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-95e51547-0cef-4f23-b93f-a305066a55fd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:14.489135 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-95e51547-0cef-4f23-b93f-a305066a55fd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:14.490718 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-95e51547-0cef-4f23-b93f-a305066a55fd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:14.494231 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-95e51547-0cef-4f23-b93f-a305066a55fd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:14.542205 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-c6868623-0a1e-4175-904e-aceb1493c9ed tempest-VolumesTestJSON-1561793938 tempest-VolumesTestJSON-1561793938-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/fada7aaa-b753-4bbe-ba87-202be4a31bf4" status: 200 len: 351 microversion: 2.1 time: 0.106834 Feb 09 13:15:14.542721 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 331/644] 10.222.0.84 () {58 vars in 1244 bytes} [Wed Feb 9 13:15:14 2022] GET /compute/v2.1/os-volumes/fada7aaa-b753-4bbe-ba87-202be4a31bf4 => generated 351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:15:14.839143 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-95e51547-0cef-4f23-b93f-a305066a55fd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:14.848716 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-95e51547-0cef-4f23-b93f-a305066a55fd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:14.854842 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-95e51547-0cef-4f23-b93f-a305066a55fd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:14.854842 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-95e51547-0cef-4f23-b93f-a305066a55fd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.380283 Feb 09 13:15:14.863826 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 314/645] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:14 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:15:15.870695 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-df73af5a-29b2-44ef-a4b9-ff344ab1cc66 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:15.878362 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-df73af5a-29b2-44ef-a4b9-ff344ab1cc66 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:15.883458 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-df73af5a-29b2-44ef-a4b9-ff344ab1cc66 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:15.883918 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-df73af5a-29b2-44ef-a4b9-ff344ab1cc66 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:15.884771 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-df73af5a-29b2-44ef-a4b9-ff344ab1cc66 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:15.885198 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-df73af5a-29b2-44ef-a4b9-ff344ab1cc66 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:16.211229 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-df73af5a-29b2-44ef-a4b9-ff344ab1cc66 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:16.230542 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-df73af5a-29b2-44ef-a4b9-ff344ab1cc66 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:16.232061 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-df73af5a-29b2-44ef-a4b9-ff344ab1cc66 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:16.233218 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-df73af5a-29b2-44ef-a4b9-ff344ab1cc66 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.367651 Feb 09 13:15:16.233776 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 332/646] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:15 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:15:16.923631 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c68ad0b2-8bf0-4532-8294-b8648e34ad79 tempest-VolumesTestJSON-1561793938 tempest-VolumesTestJSON-1561793938-project] Calling method '.version_select at 0x7f7f64f44c10>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:16.985199 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c68ad0b2-8bf0-4532-8294-b8648e34ad79 tempest-VolumesTestJSON-1561793938 tempest-VolumesTestJSON-1561793938-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/a3153a90-e312-4c05-8ba4-139c33f46f58" status: 200 len: 350 microversion: 2.1 time: 0.066504 Feb 09 13:15:16.985775 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 315/647] 10.222.0.84 () {58 vars in 1244 bytes} [Wed Feb 9 13:15:16 2022] GET /compute/v2.1/os-volumes/a3153a90-e312-4c05-8ba4-139c33f46f58 => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:15:16.998283 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-93543190-1d43-4276-b4cb-e9c7f32f4bb3 tempest-VolumesTestJSON-1561793938 tempest-VolumesTestJSON-1561793938-project] Calling method '.version_select at 0x7f7f645c6670>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:17.090783 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-93543190-1d43-4276-b4cb-e9c7f32f4bb3 tempest-VolumesTestJSON-1561793938 tempest-VolumesTestJSON-1561793938-project] 10.222.0.84 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.095838 Feb 09 13:15:17.091556 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 333/648] 10.222.0.84 () {58 vars in 1133 bytes} [Wed Feb 9 13:15:16 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:17.104481 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-40fb4b52-b26c-49df-8e40-c3272d00b99f tempest-VolumesTestJSON-1561793938 tempest-VolumesTestJSON-1561793938-project] Calling method '.version_select at 0x7f7f64fb1790>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:17.239335 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-40fb4b52-b26c-49df-8e40-c3272d00b99f tempest-VolumesTestJSON-1561793938 tempest-VolumesTestJSON-1561793938-project] 10.222.0.84 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.138970 Feb 09 13:15:17.240007 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 316/649] 10.222.0.84 () {58 vars in 1148 bytes} [Wed Feb 9 13:15:17 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:15:17.252206 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-c38f47b8-895b-400d-a29f-546e7e1835e1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:17.252588 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d6aba376-a1e7-4843-94fb-8de543e16763 tempest-VolumesTestJSON-1561793938 tempest-VolumesTestJSON-1561793938-project] Calling method '.version_select at 0x7f7f64efd670>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:17.253246 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-c38f47b8-895b-400d-a29f-546e7e1835e1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:17.281914 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c38f47b8-895b-400d-a29f-546e7e1835e1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:17.281914 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c38f47b8-895b-400d-a29f-546e7e1835e1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:17.281914 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c38f47b8-895b-400d-a29f-546e7e1835e1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:17.281914 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c38f47b8-895b-400d-a29f-546e7e1835e1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:17.387246 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d6aba376-a1e7-4843-94fb-8de543e16763 tempest-VolumesTestJSON-1561793938 tempest-VolumesTestJSON-1561793938-project] 10.222.0.84 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.138897 Feb 09 13:15:17.388333 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 317/650] 10.222.0.84 () {58 vars in 1133 bytes} [Wed Feb 9 13:15:17 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:17.407654 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c076adda-897a-4459-90b1-e075ce726bc8 tempest-VolumesTestJSON-1561793938 tempest-VolumesTestJSON-1561793938-project] Calling method '.version_select at 0x7f7f64fb1280>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:17.471249 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-c38f47b8-895b-400d-a29f-546e7e1835e1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:17.484437 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-c38f47b8-895b-400d-a29f-546e7e1835e1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:17.484437 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-c38f47b8-895b-400d-a29f-546e7e1835e1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:17.484781 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-c38f47b8-895b-400d-a29f-546e7e1835e1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.236852 Feb 09 13:15:17.496422 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 334/651] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:17 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:15:17.538258 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c076adda-897a-4459-90b1-e075ce726bc8 tempest-VolumesTestJSON-1561793938 tempest-VolumesTestJSON-1561793938-project] 10.222.0.84 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.141942 Feb 09 13:15:17.539290 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 318/652] 10.222.0.84 () {58 vars in 1166 bytes} [Wed Feb 9 13:15:17 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:15:17.551291 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-eae1261a-a5c9-47f8-9719-735177703911 tempest-VolumesTestJSON-1561793938 tempest-VolumesTestJSON-1561793938-project] Calling method '.version_select at 0x7f7f647b65e0>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:17.638242 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-eae1261a-a5c9-47f8-9719-735177703911 tempest-VolumesTestJSON-1561793938 tempest-VolumesTestJSON-1561793938-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091019 Feb 09 13:15:17.638880 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 335/653] 10.222.0.84 () {58 vars in 1169 bytes} [Wed Feb 9 13:15:17 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:15:17.650981 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-31399893-3a1f-4a08-94d0-f04d5d81675b tempest-VolumesTestJSON-1561793938 tempest-VolumesTestJSON-1561793938-project] Calling method '.version_select at 0x7f7f64f72dc0>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:17.764958 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-31399893-3a1f-4a08-94d0-f04d5d81675b tempest-VolumesTestJSON-1561793938 tempest-VolumesTestJSON-1561793938-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.117786 Feb 09 13:15:17.765810 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 319/654] 10.222.0.84 () {58 vars in 1154 bytes} [Wed Feb 9 13:15:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:17.777734 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-29a4e734-57e3-4dc3-9a02-51b0eb0bc66d tempest-VolumesTestJSON-1561793938 tempest-VolumesTestJSON-1561793938-project] Calling method '.version_select at 0x7f7f645f2dc0>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:17.890286 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-29a4e734-57e3-4dc3-9a02-51b0eb0bc66d tempest-VolumesTestJSON-1561793938 tempest-VolumesTestJSON-1561793938-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.117063 Feb 09 13:15:17.890921 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 336/655] 10.222.0.84 () {58 vars in 1187 bytes} [Wed Feb 9 13:15:17 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:15:17.905283 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-1a212cf0-23f0-4b18-a4b3-e89c3ffb508a tempest-VolumesTestJSON-1561793938 tempest-VolumesTestJSON-1561793938-project] Calling method '.version_select at 0x7f7f64efdb80>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:18.035001 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-1a212cf0-23f0-4b18-a4b3-e89c3ffb508a tempest-VolumesTestJSON-1561793938 tempest-VolumesTestJSON-1561793938-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.136281 Feb 09 13:15:18.035758 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 320/656] 10.222.0.84 () {58 vars in 1154 bytes} [Wed Feb 9 13:15:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:18.504693 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-432a3193-baaf-483f-802b-95876b1c7a0a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:18.506103 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-432a3193-baaf-483f-802b-95876b1c7a0a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:18.517846 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-432a3193-baaf-483f-802b-95876b1c7a0a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:18.517846 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-432a3193-baaf-483f-802b-95876b1c7a0a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:18.517846 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-432a3193-baaf-483f-802b-95876b1c7a0a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:18.517846 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-432a3193-baaf-483f-802b-95876b1c7a0a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:18.682512 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-432a3193-baaf-483f-802b-95876b1c7a0a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:18.692237 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-432a3193-baaf-483f-802b-95876b1c7a0a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:18.693830 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-432a3193-baaf-483f-802b-95876b1c7a0a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:18.695138 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-432a3193-baaf-483f-802b-95876b1c7a0a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.195233 Feb 09 13:15:18.703238 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 337/657] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:18 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:15:19.375334 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-b2d1452f-8b3c-4375-b020-5572873d8ea9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:19.376667 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-b2d1452f-8b3c-4375-b020-5572873d8ea9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:19.396769 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b2d1452f-8b3c-4375-b020-5572873d8ea9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:19.397432 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b2d1452f-8b3c-4375-b020-5572873d8ea9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:19.398429 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b2d1452f-8b3c-4375-b020-5572873d8ea9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:19.401495 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b2d1452f-8b3c-4375-b020-5572873d8ea9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:19.705133 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.objects.instance [None req-b2d1452f-8b3c-4375-b020-5572873d8ea9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lazy-loading 'services' on Instance uuid 7d2bee05-65c9-445a-a7ca-98808614d991 {{(pid=116749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:15:19.715289 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-37516774-8dbd-4bee-bf80-b9235a73c916 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:19.716645 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-37516774-8dbd-4bee-bf80-b9235a73c916 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:19.729939 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-37516774-8dbd-4bee-bf80-b9235a73c916 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:19.729939 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-37516774-8dbd-4bee-bf80-b9235a73c916 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:19.729939 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-37516774-8dbd-4bee-bf80-b9235a73c916 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:19.729939 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-37516774-8dbd-4bee-bf80-b9235a73c916 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:19.861206 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-37516774-8dbd-4bee-bf80-b9235a73c916 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:19.872493 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-37516774-8dbd-4bee-bf80-b9235a73c916 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:19.874508 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-37516774-8dbd-4bee-bf80-b9235a73c916 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:19.876629 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-37516774-8dbd-4bee-bf80-b9235a73c916 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.165594 Feb 09 13:15:19.887161 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 338/658] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:19 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:15:20.067452 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-b2d1452f-8b3c-4375-b020-5572873d8ea9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "DELETE /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991/os-volume_attachments/56c61a13-17da-4aee-9498-766997db5c07" status: 202 len: 0 microversion: 2.1 time: 0.697415 Feb 09 13:15:20.067961 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 321/659] 10.222.0.84 () {58 vars in 1415 bytes} [Wed Feb 9 13:15:19 2022] DELETE /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991/os-volume_attachments/56c61a13-17da-4aee-9498-766997db5c07 => generated 0 bytes in 699 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:15:20.895806 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-290fcbd4-47c9-4caa-90e5-e41729f2a0f6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:20.896323 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-290fcbd4-47c9-4caa-90e5-e41729f2a0f6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:20.903537 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-290fcbd4-47c9-4caa-90e5-e41729f2a0f6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:20.903989 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-290fcbd4-47c9-4caa-90e5-e41729f2a0f6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:20.904780 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-290fcbd4-47c9-4caa-90e5-e41729f2a0f6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:20.905232 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-290fcbd4-47c9-4caa-90e5-e41729f2a0f6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:21.103520 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-290fcbd4-47c9-4caa-90e5-e41729f2a0f6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:21.103520 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-290fcbd4-47c9-4caa-90e5-e41729f2a0f6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:21.105616 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-290fcbd4-47c9-4caa-90e5-e41729f2a0f6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:21.106817 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-290fcbd4-47c9-4caa-90e5-e41729f2a0f6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.214872 Feb 09 13:15:21.107372 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 339/660] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:20 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:15:21.796855 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-42987a06-e5cf-4ad4-992f-65a4d9bb6a53 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:15:21.797998 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-42987a06-e5cf-4ad4-992f-65a4d9bb6a53 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:21.804100 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-42987a06-e5cf-4ad4-992f-65a4d9bb6a53 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:21.804617 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-42987a06-e5cf-4ad4-992f-65a4d9bb6a53 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:21.805395 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-42987a06-e5cf-4ad4-992f-65a4d9bb6a53 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:21.805833 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-42987a06-e5cf-4ad4-992f-65a4d9bb6a53 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:22.032795 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-42987a06-e5cf-4ad4-992f-65a4d9bb6a53 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "POST /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618/action" status: 202 len: 0 microversion: 2.1 time: 0.241136 Feb 09 13:15:22.036362 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 322/661] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Feb 9 13:15:21 2022] POST /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:15:22.041224 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-60640967-3743-42b2-a322-375689f6b68e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:22.041867 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-60640967-3743-42b2-a322-375689f6b68e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:22.053504 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-60640967-3743-42b2-a322-375689f6b68e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:22.053504 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-60640967-3743-42b2-a322-375689f6b68e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:22.053504 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-60640967-3743-42b2-a322-375689f6b68e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:22.053504 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-60640967-3743-42b2-a322-375689f6b68e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:22.127034 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-f7c9a5a2-78f5-4352-8086-6a2a686849ff tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:22.128558 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-f7c9a5a2-78f5-4352-8086-6a2a686849ff tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:22.139502 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f7c9a5a2-78f5-4352-8086-6a2a686849ff tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:22.140344 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f7c9a5a2-78f5-4352-8086-6a2a686849ff tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:22.141751 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f7c9a5a2-78f5-4352-8086-6a2a686849ff tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:22.142495 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f7c9a5a2-78f5-4352-8086-6a2a686849ff tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:22.275771 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-60640967-3743-42b2-a322-375689f6b68e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:22.298465 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-60640967-3743-42b2-a322-375689f6b68e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1750 microversion: 2.1 time: 0.260194 Feb 09 13:15:22.309481 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 340/662] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:22 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1750 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:22.315434 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-4a5724b0-3e8d-4792-9dee-f487d6e440e1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:15:22.327923 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4a5724b0-3e8d-4792-9dee-f487d6e440e1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:22.328411 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4a5724b0-3e8d-4792-9dee-f487d6e440e1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:22.353611 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-4a5724b0-3e8d-4792-9dee-f487d6e440e1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Going to try to stop instance {{(pid=116748) force_stop /opt/stack/nova/nova/compute/api.py:2655}} Feb 09 13:15:22.421277 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-f7c9a5a2-78f5-4352-8086-6a2a686849ff tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:22.429562 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-f7c9a5a2-78f5-4352-8086-6a2a686849ff tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:22.431112 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-f7c9a5a2-78f5-4352-8086-6a2a686849ff tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:22.432868 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-f7c9a5a2-78f5-4352-8086-6a2a686849ff tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.310575 Feb 09 13:15:22.438226 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 323/663] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:22 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:15:22.660015 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-4a5724b0-3e8d-4792-9dee-f487d6e440e1 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "POST /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991/action" status: 202 len: 0 microversion: 2.1 time: 0.353985 Feb 09 13:15:22.661423 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 341/664] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Feb 9 13:15:22 2022] POST /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:15:22.669606 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-dda4b1ab-eaef-49d1-9a26-46dc35b13f28 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:22.670625 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-dda4b1ab-eaef-49d1-9a26-46dc35b13f28 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:22.677461 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-dda4b1ab-eaef-49d1-9a26-46dc35b13f28 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:22.678599 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-dda4b1ab-eaef-49d1-9a26-46dc35b13f28 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:22.683923 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-dda4b1ab-eaef-49d1-9a26-46dc35b13f28 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:22.685155 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-dda4b1ab-eaef-49d1-9a26-46dc35b13f28 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:22.940637 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-dda4b1ab-eaef-49d1-9a26-46dc35b13f28 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:22.954870 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-dda4b1ab-eaef-49d1-9a26-46dc35b13f28 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1679 microversion: 2.1 time: 0.289327 Feb 09 13:15:22.955657 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 324/665] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:22 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1679 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:23.319641 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-a1051162-6558-4b6f-a1e9-005a1417d0d3 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:23.321043 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-a1051162-6558-4b6f-a1e9-005a1417d0d3 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:23.333867 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a1051162-6558-4b6f-a1e9-005a1417d0d3 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:23.334713 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a1051162-6558-4b6f-a1e9-005a1417d0d3 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:23.335831 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a1051162-6558-4b6f-a1e9-005a1417d0d3 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:23.336533 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a1051162-6558-4b6f-a1e9-005a1417d0d3 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:23.452102 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ff940440-1ec2-46d4-a1ed-72c836f7b83a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:23.452715 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-ff940440-1ec2-46d4-a1ed-72c836f7b83a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:23.458698 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ff940440-1ec2-46d4-a1ed-72c836f7b83a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:23.459440 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ff940440-1ec2-46d4-a1ed-72c836f7b83a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:23.461133 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ff940440-1ec2-46d4-a1ed-72c836f7b83a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:23.461592 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ff940440-1ec2-46d4-a1ed-72c836f7b83a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:23.597375 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a1051162-6558-4b6f-a1e9-005a1417d0d3 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:23.610684 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-a1051162-6558-4b6f-a1e9-005a1417d0d3 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1755 microversion: 2.1 time: 0.296974 Feb 09 13:15:23.611539 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 342/666] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:23 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1755 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:23.691064 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ff940440-1ec2-46d4-a1ed-72c836f7b83a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:23.700323 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ff940440-1ec2-46d4-a1ed-72c836f7b83a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:23.701826 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ff940440-1ec2-46d4-a1ed-72c836f7b83a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:23.703002 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-ff940440-1ec2-46d4-a1ed-72c836f7b83a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.255575 Feb 09 13:15:23.703563 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 325/667] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:23 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:15:23.971469 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-cbafd3bf-9135-4c2a-a9dd-f1a3f9d8d36b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:23.976572 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-cbafd3bf-9135-4c2a-a9dd-f1a3f9d8d36b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:23.978142 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cbafd3bf-9135-4c2a-a9dd-f1a3f9d8d36b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:23.978617 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cbafd3bf-9135-4c2a-a9dd-f1a3f9d8d36b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:23.979402 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cbafd3bf-9135-4c2a-a9dd-f1a3f9d8d36b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:23.979836 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cbafd3bf-9135-4c2a-a9dd-f1a3f9d8d36b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:24.129240 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-cbafd3bf-9135-4c2a-a9dd-f1a3f9d8d36b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:24.137434 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-cbafd3bf-9135-4c2a-a9dd-f1a3f9d8d36b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1679 microversion: 2.1 time: 0.169658 Feb 09 13:15:24.138157 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 343/668] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:23 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:24.629698 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-7e4e3daa-45a5-49ef-a305-b04f410e666f tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:24.631047 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-7e4e3daa-45a5-49ef-a305-b04f410e666f tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:24.639480 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7e4e3daa-45a5-49ef-a305-b04f410e666f tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:24.640397 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7e4e3daa-45a5-49ef-a305-b04f410e666f tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:24.641894 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7e4e3daa-45a5-49ef-a305-b04f410e666f tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:24.642603 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7e4e3daa-45a5-49ef-a305-b04f410e666f tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:24.722746 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-2fa7845d-b63d-435d-8586-888165a8b80f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:24.723491 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-2fa7845d-b63d-435d-8586-888165a8b80f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:24.731094 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2fa7845d-b63d-435d-8586-888165a8b80f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:24.731633 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2fa7845d-b63d-435d-8586-888165a8b80f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:24.733059 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2fa7845d-b63d-435d-8586-888165a8b80f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:24.733542 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2fa7845d-b63d-435d-8586-888165a8b80f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:24.864545 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-7e4e3daa-45a5-49ef-a305-b04f410e666f tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:24.873054 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-7e4e3daa-45a5-49ef-a305-b04f410e666f tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1755 microversion: 2.1 time: 0.247437 Feb 09 13:15:24.874042 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 326/669] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:24 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1755 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:24.906300 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-2fa7845d-b63d-435d-8586-888165a8b80f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:24.916552 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-2fa7845d-b63d-435d-8586-888165a8b80f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:24.917262 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-2fa7845d-b63d-435d-8586-888165a8b80f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:24.918590 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-2fa7845d-b63d-435d-8586-888165a8b80f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.200342 Feb 09 13:15:24.919211 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 344/670] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:24 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:15:25.156408 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-1961aed7-fe05-4d0d-bbd7-0cc51e668522 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:25.157017 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-1961aed7-fe05-4d0d-bbd7-0cc51e668522 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:25.162924 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1961aed7-fe05-4d0d-bbd7-0cc51e668522 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:25.163648 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1961aed7-fe05-4d0d-bbd7-0cc51e668522 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:25.164350 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1961aed7-fe05-4d0d-bbd7-0cc51e668522 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:25.164794 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1961aed7-fe05-4d0d-bbd7-0cc51e668522 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:25.330910 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-1961aed7-fe05-4d0d-bbd7-0cc51e668522 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:25.338981 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-1961aed7-fe05-4d0d-bbd7-0cc51e668522 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1679 microversion: 2.1 time: 0.186416 Feb 09 13:15:25.339789 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 327/671] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:25 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1679 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:25.891281 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-0ab8e69d-ad7d-4211-ba0a-b29184a22fc7 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:25.892110 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-0ab8e69d-ad7d-4211-ba0a-b29184a22fc7 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:25.898656 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0ab8e69d-ad7d-4211-ba0a-b29184a22fc7 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:25.899107 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0ab8e69d-ad7d-4211-ba0a-b29184a22fc7 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:25.899896 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0ab8e69d-ad7d-4211-ba0a-b29184a22fc7 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:25.900698 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0ab8e69d-ad7d-4211-ba0a-b29184a22fc7 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:25.937291 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-633a544a-b66e-4c92-a7de-a51f8597f7a9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:25.937897 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-633a544a-b66e-4c92-a7de-a51f8597f7a9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:25.944386 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-633a544a-b66e-4c92-a7de-a51f8597f7a9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:25.944834 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-633a544a-b66e-4c92-a7de-a51f8597f7a9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:25.945722 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-633a544a-b66e-4c92-a7de-a51f8597f7a9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:25.946076 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-633a544a-b66e-4c92-a7de-a51f8597f7a9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:26.083073 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-0ab8e69d-ad7d-4211-ba0a-b29184a22fc7 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:26.094681 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-0ab8e69d-ad7d-4211-ba0a-b29184a22fc7 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1755 microversion: 2.1 time: 0.206566 Feb 09 13:15:26.095292 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 345/672] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:25 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1755 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:26.106756 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-633a544a-b66e-4c92-a7de-a51f8597f7a9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:26.116378 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-633a544a-b66e-4c92-a7de-a51f8597f7a9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:26.118046 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-633a544a-b66e-4c92-a7de-a51f8597f7a9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:26.119356 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-633a544a-b66e-4c92-a7de-a51f8597f7a9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.185868 Feb 09 13:15:26.120096 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 328/673] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:25 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:15:26.358444 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-51dc7207-60e1-4701-8bfd-921dec4a900e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:26.359284 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-51dc7207-60e1-4701-8bfd-921dec4a900e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:26.365865 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-51dc7207-60e1-4701-8bfd-921dec4a900e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:26.366517 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-51dc7207-60e1-4701-8bfd-921dec4a900e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:26.367411 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-51dc7207-60e1-4701-8bfd-921dec4a900e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:26.367854 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-51dc7207-60e1-4701-8bfd-921dec4a900e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:26.504848 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-51dc7207-60e1-4701-8bfd-921dec4a900e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:26.512655 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-51dc7207-60e1-4701-8bfd-921dec4a900e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1679 microversion: 2.1 time: 0.158409 Feb 09 13:15:26.513225 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 346/674] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:26 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:27.112651 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-017d41f7-d7a1-461b-aabf-a206306a987d tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:27.113304 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-017d41f7-d7a1-461b-aabf-a206306a987d tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:27.120764 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-017d41f7-d7a1-461b-aabf-a206306a987d tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:27.121307 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-017d41f7-d7a1-461b-aabf-a206306a987d tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:27.122284 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-017d41f7-d7a1-461b-aabf-a206306a987d tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:27.122883 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-017d41f7-d7a1-461b-aabf-a206306a987d tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:27.137137 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-fadc6aed-3c61-48d9-8edf-1954ead4d24f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:27.137777 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-fadc6aed-3c61-48d9-8edf-1954ead4d24f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:27.145092 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fadc6aed-3c61-48d9-8edf-1954ead4d24f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:27.145659 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fadc6aed-3c61-48d9-8edf-1954ead4d24f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:27.146606 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fadc6aed-3c61-48d9-8edf-1954ead4d24f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:27.147007 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fadc6aed-3c61-48d9-8edf-1954ead4d24f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:27.301865 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-017d41f7-d7a1-461b-aabf-a206306a987d tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:27.301988 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-fadc6aed-3c61-48d9-8edf-1954ead4d24f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:27.303846 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-017d41f7-d7a1-461b-aabf-a206306a987d tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1755 microversion: 2.1 time: 0.195046 Feb 09 13:15:27.304419 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 329/675] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:27 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1755 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:27.309383 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-fadc6aed-3c61-48d9-8edf-1954ead4d24f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:27.310959 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-fadc6aed-3c61-48d9-8edf-1954ead4d24f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:27.312270 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-fadc6aed-3c61-48d9-8edf-1954ead4d24f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.178988 Feb 09 13:15:27.313353 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 347/676] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:27 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:15:27.529984 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-648946a1-c0a6-4f0a-adc4-cda638e22ef6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:27.530596 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-648946a1-c0a6-4f0a-adc4-cda638e22ef6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:27.538862 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-648946a1-c0a6-4f0a-adc4-cda638e22ef6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:27.538862 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-648946a1-c0a6-4f0a-adc4-cda638e22ef6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:27.538862 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-648946a1-c0a6-4f0a-adc4-cda638e22ef6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:27.538862 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-648946a1-c0a6-4f0a-adc4-cda638e22ef6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:27.685246 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-648946a1-c0a6-4f0a-adc4-cda638e22ef6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:27.693730 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-648946a1-c0a6-4f0a-adc4-cda638e22ef6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1679 microversion: 2.1 time: 0.168479 Feb 09 13:15:27.698325 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 330/677] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:27 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:28.321492 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-b6f13406-43e8-4e13-9ace-8f8f5c429462 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:28.322108 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-b6f13406-43e8-4e13-9ace-8f8f5c429462 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:28.330052 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b6f13406-43e8-4e13-9ace-8f8f5c429462 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:28.330390 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-060694e9-d89c-4112-a4db-5d1441d8a5be tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:28.330891 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b6f13406-43e8-4e13-9ace-8f8f5c429462 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:28.331108 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-060694e9-d89c-4112-a4db-5d1441d8a5be tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:28.331565 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b6f13406-43e8-4e13-9ace-8f8f5c429462 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:28.332056 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b6f13406-43e8-4e13-9ace-8f8f5c429462 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:28.338958 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-060694e9-d89c-4112-a4db-5d1441d8a5be tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:28.339408 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-060694e9-d89c-4112-a4db-5d1441d8a5be tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:28.340233 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-060694e9-d89c-4112-a4db-5d1441d8a5be tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:28.340662 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-060694e9-d89c-4112-a4db-5d1441d8a5be tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:28.551003 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-b6f13406-43e8-4e13-9ace-8f8f5c429462 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:28.558399 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-060694e9-d89c-4112-a4db-5d1441d8a5be tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:28.571204 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-060694e9-d89c-4112-a4db-5d1441d8a5be tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:28.574953 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-b6f13406-43e8-4e13-9ace-8f8f5c429462 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1755 microversion: 2.1 time: 0.257154 Feb 09 13:15:28.577790 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 348/678] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:28 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1755 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:28.577913 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-060694e9-d89c-4112-a4db-5d1441d8a5be tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:28.577913 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-060694e9-d89c-4112-a4db-5d1441d8a5be tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.250821 Feb 09 13:15:28.577913 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 331/679] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:28 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:15:28.712706 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-33c5b3f9-2037-4d8d-83cf-e530fd9bfd96 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:28.713788 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-33c5b3f9-2037-4d8d-83cf-e530fd9bfd96 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:28.719976 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-33c5b3f9-2037-4d8d-83cf-e530fd9bfd96 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:28.720463 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-33c5b3f9-2037-4d8d-83cf-e530fd9bfd96 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:28.721464 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-33c5b3f9-2037-4d8d-83cf-e530fd9bfd96 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:28.722098 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-33c5b3f9-2037-4d8d-83cf-e530fd9bfd96 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:28.884168 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-33c5b3f9-2037-4d8d-83cf-e530fd9bfd96 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:28.892007 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-33c5b3f9-2037-4d8d-83cf-e530fd9bfd96 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1679 microversion: 2.1 time: 0.183959 Feb 09 13:15:28.892589 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 349/680] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:28 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:29.592673 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-a5f2d2b8-f838-4738-8855-6eb84b478b34 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:29.593429 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-a5f2d2b8-f838-4738-8855-6eb84b478b34 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:29.597175 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-99f934a7-0573-4d53-844a-b54ab1bf865a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:29.597784 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-99f934a7-0573-4d53-844a-b54ab1bf865a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:29.599915 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a5f2d2b8-f838-4738-8855-6eb84b478b34 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:29.600354 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a5f2d2b8-f838-4738-8855-6eb84b478b34 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:29.601147 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a5f2d2b8-f838-4738-8855-6eb84b478b34 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:29.601580 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a5f2d2b8-f838-4738-8855-6eb84b478b34 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:29.604938 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-99f934a7-0573-4d53-844a-b54ab1bf865a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:29.605386 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-99f934a7-0573-4d53-844a-b54ab1bf865a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:29.606181 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-99f934a7-0573-4d53-844a-b54ab1bf865a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:29.606643 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-99f934a7-0573-4d53-844a-b54ab1bf865a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:29.758260 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-99f934a7-0573-4d53-844a-b54ab1bf865a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:29.758431 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-a5f2d2b8-f838-4738-8855-6eb84b478b34 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:29.767130 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-99f934a7-0573-4d53-844a-b54ab1bf865a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:29.768848 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-a5f2d2b8-f838-4738-8855-6eb84b478b34 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1755 microversion: 2.1 time: 0.179695 Feb 09 13:15:29.769501 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-99f934a7-0573-4d53-844a-b54ab1bf865a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:29.770857 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-99f934a7-0573-4d53-844a-b54ab1bf865a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.177449 Feb 09 13:15:29.771905 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 350/681] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:29 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:15:29.779721 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 332/682] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:29 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1755 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:29.913655 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-a5c51c5e-2b1b-4de7-95e6-86686cfce74e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:29.913655 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-a5c51c5e-2b1b-4de7-95e6-86686cfce74e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:29.917716 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a5c51c5e-2b1b-4de7-95e6-86686cfce74e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:29.917935 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a5c51c5e-2b1b-4de7-95e6-86686cfce74e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:29.918714 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a5c51c5e-2b1b-4de7-95e6-86686cfce74e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:29.919438 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a5c51c5e-2b1b-4de7-95e6-86686cfce74e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:30.070094 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a5c51c5e-2b1b-4de7-95e6-86686cfce74e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:30.071573 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-3b437d8d-fb7f-4212-8667-15490ef59fb3 req-a5f3da37-082a-4115-ae1a-13fc13b295a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267a95df-7ddb-4e9c-a629-4fc26b9c9843", "name": "network-vif-plugged", "status": "completed", "tag": "45e332d3-92b6-4aa9-9b18-a8fa5ca22e31"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:15:30.074247 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:15:30.074247 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:15:30.078610 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-a5c51c5e-2b1b-4de7-95e6-86686cfce74e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1679 microversion: 2.1 time: 0.172933 Feb 09 13:15:30.080518 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 351/683] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:29 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:30.092561 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-3b437d8d-fb7f-4212-8667-15490ef59fb3 req-a5f3da37-082a-4115-ae1a-13fc13b295a9 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:30.093007 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-3b437d8d-fb7f-4212-8667-15490ef59fb3 req-a5f3da37-082a-4115-ae1a-13fc13b295a9 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:30.105098 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-3b437d8d-fb7f-4212-8667-15490ef59fb3 req-a5f3da37-082a-4115-ae1a-13fc13b295a9 service nova] Creating event network-vif-plugged:45e332d3-92b6-4aa9-9b18-a8fa5ca22e31 for instance 267a95df-7ddb-4e9c-a629-4fc26b9c9843 on hv-cinder-82786 Feb 09 13:15:30.111052 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-3b437d8d-fb7f-4212-8667-15490ef59fb3 req-a5f3da37-082a-4115-ae1a-13fc13b295a9 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043559 Feb 09 13:15:30.111654 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 333/684] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:15:30.786232 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-7f2a8455-f72e-43b5-b279-b6fa6486d92e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:30.786948 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-7f2a8455-f72e-43b5-b279-b6fa6486d92e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:30.790764 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c9c99948-1047-4d91-b77f-27458905d707 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:30.791851 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-c9c99948-1047-4d91-b77f-27458905d707 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:30.793957 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7f2a8455-f72e-43b5-b279-b6fa6486d92e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:30.794415 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7f2a8455-f72e-43b5-b279-b6fa6486d92e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:30.795257 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7f2a8455-f72e-43b5-b279-b6fa6486d92e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:30.795697 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7f2a8455-f72e-43b5-b279-b6fa6486d92e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:30.799102 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c9c99948-1047-4d91-b77f-27458905d707 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:30.799559 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c9c99948-1047-4d91-b77f-27458905d707 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:30.800343 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c9c99948-1047-4d91-b77f-27458905d707 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:30.800774 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c9c99948-1047-4d91-b77f-27458905d707 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:30.939116 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c9c99948-1047-4d91-b77f-27458905d707 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:30.948922 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c9c99948-1047-4d91-b77f-27458905d707 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:30.950676 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c9c99948-1047-4d91-b77f-27458905d707 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:30.952200 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c9c99948-1047-4d91-b77f-27458905d707 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.166571 Feb 09 13:15:30.952818 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 334/685] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:30 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:15:30.962044 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-7f2a8455-f72e-43b5-b279-b6fa6486d92e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:30.970789 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-7f2a8455-f72e-43b5-b279-b6fa6486d92e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1755 microversion: 2.1 time: 0.188355 Feb 09 13:15:30.971370 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 352/686] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:30 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:31.096400 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-eb2a1067-9046-4316-b1e6-e1763702231d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:31.097094 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-eb2a1067-9046-4316-b1e6-e1763702231d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:31.102745 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-eb2a1067-9046-4316-b1e6-e1763702231d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:31.103194 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-eb2a1067-9046-4316-b1e6-e1763702231d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:31.103995 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-eb2a1067-9046-4316-b1e6-e1763702231d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:31.104425 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-eb2a1067-9046-4316-b1e6-e1763702231d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:31.246228 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-eb2a1067-9046-4316-b1e6-e1763702231d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:31.248401 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-eb2a1067-9046-4316-b1e6-e1763702231d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1679 microversion: 2.1 time: 0.155678 Feb 09 13:15:31.248973 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 335/687] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:31 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:31.970936 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-e47cd4ea-31b1-4b8c-b503-1423979ff507 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:31.971571 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-e47cd4ea-31b1-4b8c-b503-1423979ff507 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:31.978275 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e47cd4ea-31b1-4b8c-b503-1423979ff507 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:31.979354 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e47cd4ea-31b1-4b8c-b503-1423979ff507 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:31.980226 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e47cd4ea-31b1-4b8c-b503-1423979ff507 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:31.980718 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e47cd4ea-31b1-4b8c-b503-1423979ff507 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:31.987248 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-037de2e8-8072-4242-afff-fc9f7041c63c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:31.987851 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-037de2e8-8072-4242-afff-fc9f7041c63c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:31.994165 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-037de2e8-8072-4242-afff-fc9f7041c63c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:31.994631 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-037de2e8-8072-4242-afff-fc9f7041c63c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:31.995448 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-037de2e8-8072-4242-afff-fc9f7041c63c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:31.995845 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-037de2e8-8072-4242-afff-fc9f7041c63c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:32.129660 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e47cd4ea-31b1-4b8c-b503-1423979ff507 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:32.138117 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e47cd4ea-31b1-4b8c-b503-1423979ff507 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:32.139648 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e47cd4ea-31b1-4b8c-b503-1423979ff507 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:32.140813 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-e47cd4ea-31b1-4b8c-b503-1423979ff507 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.173929 Feb 09 13:15:32.141385 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 353/688] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:31 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:15:32.144815 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-037de2e8-8072-4242-afff-fc9f7041c63c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:32.153288 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-037de2e8-8072-4242-afff-fc9f7041c63c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1755 microversion: 2.1 time: 0.169794 Feb 09 13:15:32.153847 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 336/689] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:31 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:15:32.265305 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-474bc0ed-a3e3-4673-a580-ca3fc2c6d68c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:32.265928 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-474bc0ed-a3e3-4673-a580-ca3fc2c6d68c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:32.271807 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-474bc0ed-a3e3-4673-a580-ca3fc2c6d68c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:32.272269 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-474bc0ed-a3e3-4673-a580-ca3fc2c6d68c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:32.281877 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-474bc0ed-a3e3-4673-a580-ca3fc2c6d68c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:32.281877 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-474bc0ed-a3e3-4673-a580-ca3fc2c6d68c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:32.417951 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-474bc0ed-a3e3-4673-a580-ca3fc2c6d68c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:32.425270 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-474bc0ed-a3e3-4673-a580-ca3fc2c6d68c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1679 microversion: 2.1 time: 0.163648 Feb 09 13:15:32.425836 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 354/690] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:32 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:15:33.159427 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-3e4f7954-0245-49fd-ab59-d2c891d55cae tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:33.160020 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-3e4f7954-0245-49fd-ab59-d2c891d55cae tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:33.166240 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3e4f7954-0245-49fd-ab59-d2c891d55cae tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:33.166727 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3e4f7954-0245-49fd-ab59-d2c891d55cae tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:33.167500 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3e4f7954-0245-49fd-ab59-d2c891d55cae tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:33.167933 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3e4f7954-0245-49fd-ab59-d2c891d55cae tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:33.170100 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-b34fa75d-4cbc-41e1-a06f-9bd216ac5f15 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:33.170752 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-b34fa75d-4cbc-41e1-a06f-9bd216ac5f15 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:33.177030 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b34fa75d-4cbc-41e1-a06f-9bd216ac5f15 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:33.177483 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b34fa75d-4cbc-41e1-a06f-9bd216ac5f15 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:33.178291 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b34fa75d-4cbc-41e1-a06f-9bd216ac5f15 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:33.178755 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b34fa75d-4cbc-41e1-a06f-9bd216ac5f15 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:33.304054 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3e4f7954-0245-49fd-ab59-d2c891d55cae tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:33.312108 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3e4f7954-0245-49fd-ab59-d2c891d55cae tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:33.313606 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3e4f7954-0245-49fd-ab59-d2c891d55cae tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:33.314786 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-3e4f7954-0245-49fd-ab59-d2c891d55cae tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.159068 Feb 09 13:15:33.315350 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 337/691] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:33 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:15:33.330769 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-b34fa75d-4cbc-41e1-a06f-9bd216ac5f15 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:33.340397 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-b34fa75d-4cbc-41e1-a06f-9bd216ac5f15 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1755 microversion: 2.1 time: 0.173982 Feb 09 13:15:33.341090 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 355/692] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:33 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:15:33.445951 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-546d9fc7-fb52-4f13-b47c-332dbdf92d55 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:33.446628 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-546d9fc7-fb52-4f13-b47c-332dbdf92d55 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:33.453511 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-546d9fc7-fb52-4f13-b47c-332dbdf92d55 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:33.453987 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-546d9fc7-fb52-4f13-b47c-332dbdf92d55 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:33.454870 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-546d9fc7-fb52-4f13-b47c-332dbdf92d55 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:33.455316 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-546d9fc7-fb52-4f13-b47c-332dbdf92d55 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:33.590312 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-546d9fc7-fb52-4f13-b47c-332dbdf92d55 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:33.597655 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-546d9fc7-fb52-4f13-b47c-332dbdf92d55 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1679 microversion: 2.1 time: 0.155646 Feb 09 13:15:33.598218 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 338/693] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:33 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:34.333168 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-6538e3e7-960f-4b8b-9607-489faee30a6e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:34.333809 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-6538e3e7-960f-4b8b-9607-489faee30a6e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:34.340644 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6538e3e7-960f-4b8b-9607-489faee30a6e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:34.341091 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6538e3e7-960f-4b8b-9607-489faee30a6e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:34.341866 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6538e3e7-960f-4b8b-9607-489faee30a6e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:34.342296 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6538e3e7-960f-4b8b-9607-489faee30a6e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:34.358527 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c4f7e3ba-770c-4839-88d8-f4e30290660c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:34.359345 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-c4f7e3ba-770c-4839-88d8-f4e30290660c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:34.365766 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c4f7e3ba-770c-4839-88d8-f4e30290660c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:34.366272 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c4f7e3ba-770c-4839-88d8-f4e30290660c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:34.367137 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c4f7e3ba-770c-4839-88d8-f4e30290660c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:34.367599 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c4f7e3ba-770c-4839-88d8-f4e30290660c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:34.494624 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6538e3e7-960f-4b8b-9607-489faee30a6e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:34.504608 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6538e3e7-960f-4b8b-9607-489faee30a6e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:34.506346 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6538e3e7-960f-4b8b-9607-489faee30a6e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:34.509476 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-6538e3e7-960f-4b8b-9607-489faee30a6e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.178768 Feb 09 13:15:34.522653 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 356/694] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:34 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:15:34.557966 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c4f7e3ba-770c-4839-88d8-f4e30290660c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:34.567212 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c4f7e3ba-770c-4839-88d8-f4e30290660c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1755 microversion: 2.1 time: 0.213353 Feb 09 13:15:34.567917 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 339/695] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:34 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1755 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:15:34.615370 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d7d79494-0f54-409b-8fea-73273d77b112 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:34.616047 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d7d79494-0f54-409b-8fea-73273d77b112 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:34.622902 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d7d79494-0f54-409b-8fea-73273d77b112 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:34.623512 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d7d79494-0f54-409b-8fea-73273d77b112 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:34.626522 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d7d79494-0f54-409b-8fea-73273d77b112 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:34.626522 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d7d79494-0f54-409b-8fea-73273d77b112 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:34.773233 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d7d79494-0f54-409b-8fea-73273d77b112 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:34.795824 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d7d79494-0f54-409b-8fea-73273d77b112 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1679 microversion: 2.1 time: 0.184744 Feb 09 13:15:34.796458 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 357/696] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:34 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:35.530219 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-a665cdcd-13dd-4c23-b38f-3f7ce2b00e3f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:35.530872 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-a665cdcd-13dd-4c23-b38f-3f7ce2b00e3f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:35.537144 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a665cdcd-13dd-4c23-b38f-3f7ce2b00e3f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:35.537513 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a665cdcd-13dd-4c23-b38f-3f7ce2b00e3f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:35.538300 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a665cdcd-13dd-4c23-b38f-3f7ce2b00e3f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:35.538786 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a665cdcd-13dd-4c23-b38f-3f7ce2b00e3f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:35.590900 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-cec18576-a867-49ed-9901-846431a4f0b3 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:35.591656 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-cec18576-a867-49ed-9901-846431a4f0b3 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:35.598969 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cec18576-a867-49ed-9901-846431a4f0b3 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:35.599474 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cec18576-a867-49ed-9901-846431a4f0b3 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:35.601556 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cec18576-a867-49ed-9901-846431a4f0b3 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:35.602198 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cec18576-a867-49ed-9901-846431a4f0b3 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:35.686037 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-a665cdcd-13dd-4c23-b38f-3f7ce2b00e3f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:35.694942 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-a665cdcd-13dd-4c23-b38f-3f7ce2b00e3f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:35.696449 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-a665cdcd-13dd-4c23-b38f-3f7ce2b00e3f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:35.697609 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-a665cdcd-13dd-4c23-b38f-3f7ce2b00e3f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.171238 Feb 09 13:15:35.698164 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 340/697] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:35 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:15:35.757292 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-cec18576-a867-49ed-9901-846431a4f0b3 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:35.765222 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-cec18576-a867-49ed-9901-846431a4f0b3 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1755 microversion: 2.1 time: 0.178371 Feb 09 13:15:35.765802 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 358/698] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:35 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:35.812253 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-323f4a57-e8d9-4b93-96cb-e603967def9a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:35.812944 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-323f4a57-e8d9-4b93-96cb-e603967def9a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:35.819044 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-323f4a57-e8d9-4b93-96cb-e603967def9a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:35.819501 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-323f4a57-e8d9-4b93-96cb-e603967def9a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:35.820345 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-323f4a57-e8d9-4b93-96cb-e603967def9a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:35.820819 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-323f4a57-e8d9-4b93-96cb-e603967def9a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:35.965596 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-323f4a57-e8d9-4b93-96cb-e603967def9a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:35.973231 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-323f4a57-e8d9-4b93-96cb-e603967def9a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1679 microversion: 2.1 time: 0.164428 Feb 09 13:15:35.973892 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 341/699] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:35 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:36.716907 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-e4c27dc0-eaa3-49f5-8fbd-063e11437286 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:36.717518 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-e4c27dc0-eaa3-49f5-8fbd-063e11437286 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:36.723733 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e4c27dc0-eaa3-49f5-8fbd-063e11437286 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:36.724115 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e4c27dc0-eaa3-49f5-8fbd-063e11437286 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:36.724893 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e4c27dc0-eaa3-49f5-8fbd-063e11437286 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:36.725334 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e4c27dc0-eaa3-49f5-8fbd-063e11437286 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:36.783293 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-15147462-8cae-4d77-a9e0-608c77c2a5b6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:36.784599 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-15147462-8cae-4d77-a9e0-608c77c2a5b6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:36.791241 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-15147462-8cae-4d77-a9e0-608c77c2a5b6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:36.791626 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-15147462-8cae-4d77-a9e0-608c77c2a5b6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:36.792434 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-15147462-8cae-4d77-a9e0-608c77c2a5b6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:36.793577 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-15147462-8cae-4d77-a9e0-608c77c2a5b6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:36.878935 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e4c27dc0-eaa3-49f5-8fbd-063e11437286 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:36.889802 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e4c27dc0-eaa3-49f5-8fbd-063e11437286 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:36.893593 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e4c27dc0-eaa3-49f5-8fbd-063e11437286 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:36.893593 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-e4c27dc0-eaa3-49f5-8fbd-063e11437286 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1806 microversion: 2.20 time: 0.180194 Feb 09 13:15:36.893838 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 359/700] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:36 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1806 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:15:36.979774 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-15147462-8cae-4d77-a9e0-608c77c2a5b6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:36.988437 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-15147462-8cae-4d77-a9e0-608c77c2a5b6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1755 microversion: 2.1 time: 0.208817 Feb 09 13:15:36.988997 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 342/701] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:36 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1755 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:15:36.991203 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-8f5e2d7d-ed45-49bc-b03b-eb85a211cbb5 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:36.991889 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-8f5e2d7d-ed45-49bc-b03b-eb85a211cbb5 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:36.998763 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8f5e2d7d-ed45-49bc-b03b-eb85a211cbb5 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:36.999326 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8f5e2d7d-ed45-49bc-b03b-eb85a211cbb5 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:37.000163 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8f5e2d7d-ed45-49bc-b03b-eb85a211cbb5 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:37.000627 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8f5e2d7d-ed45-49bc-b03b-eb85a211cbb5 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:37.147787 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-8f5e2d7d-ed45-49bc-b03b-eb85a211cbb5 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:37.155932 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-8f5e2d7d-ed45-49bc-b03b-eb85a211cbb5 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1679 microversion: 2.1 time: 0.168590 Feb 09 13:15:37.156517 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 360/702] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:36 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:15:37.914235 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-64eaa021-e573-4e8b-b4dc-94964b8a888c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:37.915010 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-64eaa021-e573-4e8b-b4dc-94964b8a888c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:37.923004 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-64eaa021-e573-4e8b-b4dc-94964b8a888c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:37.923697 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-64eaa021-e573-4e8b-b4dc-94964b8a888c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:37.924833 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-64eaa021-e573-4e8b-b4dc-94964b8a888c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:37.925455 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-64eaa021-e573-4e8b-b4dc-94964b8a888c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:38.015738 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-13f1cb3b-e818-46f2-8e7e-dd3d93e25565 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:38.015738 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-13f1cb3b-e818-46f2-8e7e-dd3d93e25565 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:38.022176 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-13f1cb3b-e818-46f2-8e7e-dd3d93e25565 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:38.022662 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-13f1cb3b-e818-46f2-8e7e-dd3d93e25565 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:38.023503 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-13f1cb3b-e818-46f2-8e7e-dd3d93e25565 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:38.024149 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-13f1cb3b-e818-46f2-8e7e-dd3d93e25565 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:38.165851 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-64eaa021-e573-4e8b-b4dc-94964b8a888c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:38.178186 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-64eaa021-e573-4e8b-b4dc-94964b8a888c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:38.179852 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-64eaa021-e573-4e8b-b4dc-94964b8a888c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:38.181335 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-64eaa021-e573-4e8b-b4dc-94964b8a888c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1793 microversion: 2.20 time: 0.271481 Feb 09 13:15:38.181991 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 343/703] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:15:37 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1793 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:15:38.193611 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-604843c0-2a20-4484-b3c9-e9a275652964 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:38.194527 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-604843c0-2a20-4484-b3c9-e9a275652964 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:38.201315 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-604843c0-2a20-4484-b3c9-e9a275652964 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:38.202047 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-604843c0-2a20-4484-b3c9-e9a275652964 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:38.203115 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-604843c0-2a20-4484-b3c9-e9a275652964 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:38.203750 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-604843c0-2a20-4484-b3c9-e9a275652964 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:38.219765 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-13f1cb3b-e818-46f2-8e7e-dd3d93e25565 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:38.228937 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-13f1cb3b-e818-46f2-8e7e-dd3d93e25565 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1755 microversion: 2.1 time: 0.226547 Feb 09 13:15:38.229612 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 361/704] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:38 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1755 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:15:38.364139 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-604843c0-2a20-4484-b3c9-e9a275652964 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:38.372296 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-604843c0-2a20-4484-b3c9-e9a275652964 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1679 microversion: 2.1 time: 0.189250 Feb 09 13:15:38.372881 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 344/705] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:38 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:39.251330 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-58c42e50-2ca6-406d-8933-74e18e95997d tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:39.251966 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-58c42e50-2ca6-406d-8933-74e18e95997d tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:39.258860 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-58c42e50-2ca6-406d-8933-74e18e95997d tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:39.259325 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-58c42e50-2ca6-406d-8933-74e18e95997d tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:39.260239 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-58c42e50-2ca6-406d-8933-74e18e95997d tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:39.260756 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-58c42e50-2ca6-406d-8933-74e18e95997d tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:39.391478 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-36c230bc-e0d5-4b4a-b1b5-009f478dd865 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:39.392551 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-36c230bc-e0d5-4b4a-b1b5-009f478dd865 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:39.402735 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-36c230bc-e0d5-4b4a-b1b5-009f478dd865 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:39.403495 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-36c230bc-e0d5-4b4a-b1b5-009f478dd865 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:39.404967 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-36c230bc-e0d5-4b4a-b1b5-009f478dd865 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:39.405882 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-36c230bc-e0d5-4b4a-b1b5-009f478dd865 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:39.441201 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-58c42e50-2ca6-406d-8933-74e18e95997d tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:39.450239 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-58c42e50-2ca6-406d-8933-74e18e95997d tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1755 microversion: 2.1 time: 0.203061 Feb 09 13:15:39.454753 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 362/706] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:39 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1755 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:39.563385 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-36c230bc-e0d5-4b4a-b1b5-009f478dd865 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:39.570696 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-36c230bc-e0d5-4b4a-b1b5-009f478dd865 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1656 microversion: 2.1 time: 0.184735 Feb 09 13:15:39.571276 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 345/707] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:39 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1656 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:39.587144 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-3eb5bd7b-033d-4c0e-be97-8316842129d7 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:15:39.593738 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3eb5bd7b-033d-4c0e-be97-8316842129d7 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:39.594198 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3eb5bd7b-033d-4c0e-be97-8316842129d7 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:39.639446 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-3eb5bd7b-033d-4c0e-be97-8316842129d7 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Going to try to start instance {{(pid=116748) start /opt/stack/nova/nova/compute/api.py:2678}} Feb 09 13:15:39.877914 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-3eb5bd7b-033d-4c0e-be97-8316842129d7 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "POST /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991/action" status: 202 len: 0 microversion: 2.1 time: 0.294122 Feb 09 13:15:39.878856 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 363/708] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Feb 9 13:15:39 2022] POST /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:15:39.886547 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-64ec7ba0-183e-4e58-9723-9611510b4276 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:39.887185 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-64ec7ba0-183e-4e58-9723-9611510b4276 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:39.893196 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-64ec7ba0-183e-4e58-9723-9611510b4276 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:39.893646 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-64ec7ba0-183e-4e58-9723-9611510b4276 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:39.894438 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-64ec7ba0-183e-4e58-9723-9611510b4276 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:39.894901 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-64ec7ba0-183e-4e58-9723-9611510b4276 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:40.072689 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-64ec7ba0-183e-4e58-9723-9611510b4276 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:40.086829 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-64ec7ba0-183e-4e58-9723-9611510b4276 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1665 microversion: 2.1 time: 0.203739 Feb 09 13:15:40.087438 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 346/709] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:39 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1665 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:40.472277 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-dd0850f0-7acc-4a01-9935-c44fa219f523 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:40.472987 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-dd0850f0-7acc-4a01-9935-c44fa219f523 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:40.479058 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-dd0850f0-7acc-4a01-9935-c44fa219f523 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:40.479515 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-dd0850f0-7acc-4a01-9935-c44fa219f523 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:40.480339 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-dd0850f0-7acc-4a01-9935-c44fa219f523 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:40.480781 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-dd0850f0-7acc-4a01-9935-c44fa219f523 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:40.665268 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-dd0850f0-7acc-4a01-9935-c44fa219f523 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:40.673144 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-dd0850f0-7acc-4a01-9935-c44fa219f523 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1755 microversion: 2.1 time: 0.205524 Feb 09 13:15:40.673715 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 364/710] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:40 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1755 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:41.107781 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-48e66876-8aa2-4e21-bac7-b2ca99ecb7c3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:41.108576 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-48e66876-8aa2-4e21-bac7-b2ca99ecb7c3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:41.115464 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-48e66876-8aa2-4e21-bac7-b2ca99ecb7c3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:41.115984 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-48e66876-8aa2-4e21-bac7-b2ca99ecb7c3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:41.116769 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-48e66876-8aa2-4e21-bac7-b2ca99ecb7c3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:41.117232 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-48e66876-8aa2-4e21-bac7-b2ca99ecb7c3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:41.308452 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-48e66876-8aa2-4e21-bac7-b2ca99ecb7c3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:41.316495 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-48e66876-8aa2-4e21-bac7-b2ca99ecb7c3 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1665 microversion: 2.1 time: 0.215714 Feb 09 13:15:41.317066 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 347/711] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:41 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1665 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:41.689071 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-5091d9e6-1065-4d80-84d1-172e6cbe30a8 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:41.689795 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-5091d9e6-1065-4d80-84d1-172e6cbe30a8 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:41.696333 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5091d9e6-1065-4d80-84d1-172e6cbe30a8 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:41.696885 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5091d9e6-1065-4d80-84d1-172e6cbe30a8 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:41.697792 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5091d9e6-1065-4d80-84d1-172e6cbe30a8 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:41.698300 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5091d9e6-1065-4d80-84d1-172e6cbe30a8 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:41.880286 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-5091d9e6-1065-4d80-84d1-172e6cbe30a8 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:41.888435 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-5091d9e6-1065-4d80-84d1-172e6cbe30a8 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1755 microversion: 2.1 time: 0.203072 Feb 09 13:15:41.888996 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 365/712] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:41 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1755 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:42.338960 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-77eb5db2-fad5-4013-86c1-5fd399b73e78 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:42.339576 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-77eb5db2-fad5-4013-86c1-5fd399b73e78 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:42.346873 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-77eb5db2-fad5-4013-86c1-5fd399b73e78 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:42.347333 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-77eb5db2-fad5-4013-86c1-5fd399b73e78 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:42.348130 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-77eb5db2-fad5-4013-86c1-5fd399b73e78 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:42.348573 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-77eb5db2-fad5-4013-86c1-5fd399b73e78 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:42.485918 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-77eb5db2-fad5-4013-86c1-5fd399b73e78 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:42.493498 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-77eb5db2-fad5-4013-86c1-5fd399b73e78 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1665 microversion: 2.1 time: 0.158500 Feb 09 13:15:42.494128 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 348/713] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:42 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1665 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:42.906960 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-fbf1396e-305a-4480-9ef6-efe9ec0b56c0 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:42.907487 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-fbf1396e-305a-4480-9ef6-efe9ec0b56c0 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:42.914099 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fbf1396e-305a-4480-9ef6-efe9ec0b56c0 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:42.914920 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fbf1396e-305a-4480-9ef6-efe9ec0b56c0 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:42.916549 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fbf1396e-305a-4480-9ef6-efe9ec0b56c0 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:42.917278 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fbf1396e-305a-4480-9ef6-efe9ec0b56c0 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:43.095302 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-fbf1396e-305a-4480-9ef6-efe9ec0b56c0 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:43.105141 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-fbf1396e-305a-4480-9ef6-efe9ec0b56c0 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1755 microversion: 2.1 time: 0.202473 Feb 09 13:15:43.106623 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 366/714] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:42 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1755 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:43.510979 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-77765657-3fa6-4e19-9586-0b8a375c5f84 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:43.511600 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-77765657-3fa6-4e19-9586-0b8a375c5f84 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:43.518668 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-77765657-3fa6-4e19-9586-0b8a375c5f84 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:43.519126 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-77765657-3fa6-4e19-9586-0b8a375c5f84 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:43.519922 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-77765657-3fa6-4e19-9586-0b8a375c5f84 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:43.520372 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-77765657-3fa6-4e19-9586-0b8a375c5f84 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:43.680374 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-77765657-3fa6-4e19-9586-0b8a375c5f84 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:43.688186 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-77765657-3fa6-4e19-9586-0b8a375c5f84 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1665 microversion: 2.1 time: 0.180895 Feb 09 13:15:43.688957 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 349/715] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:43 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1665 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:44.123569 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-3175d6c9-962b-45fd-bed2-07a8b63ff81c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:44.125282 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-3175d6c9-962b-45fd-bed2-07a8b63ff81c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:44.132155 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3175d6c9-962b-45fd-bed2-07a8b63ff81c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:44.135152 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3175d6c9-962b-45fd-bed2-07a8b63ff81c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:44.136092 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3175d6c9-962b-45fd-bed2-07a8b63ff81c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:44.137080 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3175d6c9-962b-45fd-bed2-07a8b63ff81c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:44.307207 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-3175d6c9-962b-45fd-bed2-07a8b63ff81c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:44.316711 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-3175d6c9-962b-45fd-bed2-07a8b63ff81c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1755 microversion: 2.1 time: 0.197396 Feb 09 13:15:44.317587 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 367/716] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:44 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1755 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:44.705603 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-a312298b-ee84-4881-832d-7c480a8ad1b8 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:44.706261 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-a312298b-ee84-4881-832d-7c480a8ad1b8 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:44.712681 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a312298b-ee84-4881-832d-7c480a8ad1b8 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:44.713135 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a312298b-ee84-4881-832d-7c480a8ad1b8 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:44.713985 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a312298b-ee84-4881-832d-7c480a8ad1b8 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:44.714428 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a312298b-ee84-4881-832d-7c480a8ad1b8 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:44.846216 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-a312298b-ee84-4881-832d-7c480a8ad1b8 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:44.853743 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-a312298b-ee84-4881-832d-7c480a8ad1b8 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1669 microversion: 2.1 time: 0.151696 Feb 09 13:15:44.854288 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 350/717] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:44 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:15:45.333498 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-f3056a69-3a65-4c1d-8324-99616440385e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:15:45.334666 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-f3056a69-3a65-4c1d-8324-99616440385e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:15:45.341842 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f3056a69-3a65-4c1d-8324-99616440385e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:45.342501 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f3056a69-3a65-4c1d-8324-99616440385e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:45.343498 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f3056a69-3a65-4c1d-8324-99616440385e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:15:45.344087 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f3056a69-3a65-4c1d-8324-99616440385e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:15:45.506003 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f3056a69-3a65-4c1d-8324-99616440385e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:15:45.513899 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-f3056a69-3a65-4c1d-8324-99616440385e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1758 microversion: 2.1 time: 0.184261 Feb 09 13:15:45.521439 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 368/718] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:15:45 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1758 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:16:16.766586 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-e6cee83a-604e-49cd-88db-813eaa15d712 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:16.767179 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-e6cee83a-604e-49cd-88db-813eaa15d712 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:16.772956 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e6cee83a-604e-49cd-88db-813eaa15d712 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:16.773410 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e6cee83a-604e-49cd-88db-813eaa15d712 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:16.774192 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e6cee83a-604e-49cd-88db-813eaa15d712 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:16.774658 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e6cee83a-604e-49cd-88db-813eaa15d712 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:16.803461 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-e6cee83a-604e-49cd-88db-813eaa15d712 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843/os-volume_attachments/8e11e3e3-d56a-48e8-be5f-4280fbeede12" status: 200 len: 194 microversion: 2.20 time: 0.040891 Feb 09 13:16:16.804032 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 351/719] 10.222.0.84 () {60 vars in 1453 bytes} [Wed Feb 9 13:16:16 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843/os-volume_attachments/8e11e3e3-d56a-48e8-be5f-4280fbeede12 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 09 13:16:16.864207 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-30162ff9-8c2f-4214-9f73-08511793fd62 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:16.864740 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-30162ff9-8c2f-4214-9f73-08511793fd62 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:16.870786 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-30162ff9-8c2f-4214-9f73-08511793fd62 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:16.871178 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-30162ff9-8c2f-4214-9f73-08511793fd62 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:16.871960 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-30162ff9-8c2f-4214-9f73-08511793fd62 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:16.872402 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-30162ff9-8c2f-4214-9f73-08511793fd62 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:17.149740 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-30162ff9-8c2f-4214-9f73-08511793fd62 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lazy-loading 'services' on Instance uuid 267a95df-7ddb-4e9c-a629-4fc26b9c9843 {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:16:17.363992 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-30162ff9-8c2f-4214-9f73-08511793fd62 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "DELETE /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843/os-volume_attachments/8e11e3e3-d56a-48e8-be5f-4280fbeede12" status: 202 len: 0 microversion: 2.20 time: 0.503851 Feb 09 13:16:17.364617 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 369/720] 10.222.0.84 () {60 vars in 1456 bytes} [Wed Feb 9 13:16:16 2022] DELETE /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843/os-volume_attachments/8e11e3e3-d56a-48e8-be5f-4280fbeede12 => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 09 13:16:17.372885 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-71eaf8c4-96d7-4cc3-be6a-1a1c6a8e843f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:17.373908 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-71eaf8c4-96d7-4cc3-be6a-1a1c6a8e843f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:17.380856 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-71eaf8c4-96d7-4cc3-be6a-1a1c6a8e843f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:17.380856 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-71eaf8c4-96d7-4cc3-be6a-1a1c6a8e843f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:17.381102 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-71eaf8c4-96d7-4cc3-be6a-1a1c6a8e843f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:17.381514 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-71eaf8c4-96d7-4cc3-be6a-1a1c6a8e843f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:17.411318 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-71eaf8c4-96d7-4cc3-be6a-1a1c6a8e843f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041598 Feb 09 13:16:17.415430 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 352/721] 10.222.0.84 () {60 vars in 1342 bytes} [Wed Feb 9 13:16:17 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 09 13:16:18.423975 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-32a9a1d0-eae1-4fb0-b0f3-40623f30df03 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:18.424943 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-32a9a1d0-eae1-4fb0-b0f3-40623f30df03 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:18.431103 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-32a9a1d0-eae1-4fb0-b0f3-40623f30df03 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:18.431558 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-32a9a1d0-eae1-4fb0-b0f3-40623f30df03 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:18.432353 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-32a9a1d0-eae1-4fb0-b0f3-40623f30df03 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:18.432794 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-32a9a1d0-eae1-4fb0-b0f3-40623f30df03 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:18.462037 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-32a9a1d0-eae1-4fb0-b0f3-40623f30df03 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042737 Feb 09 13:16:18.462620 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 370/722] 10.222.0.84 () {60 vars in 1342 bytes} [Wed Feb 9 13:16:18 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:16:18.518172 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d70f9193-c067-4f1d-ac51-51b7ccfdbf61 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:18.518787 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d70f9193-c067-4f1d-ac51-51b7ccfdbf61 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:18.525574 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d70f9193-c067-4f1d-ac51-51b7ccfdbf61 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:18.526327 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d70f9193-c067-4f1d-ac51-51b7ccfdbf61 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:18.527145 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d70f9193-c067-4f1d-ac51-51b7ccfdbf61 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:18.527579 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d70f9193-c067-4f1d-ac51-51b7ccfdbf61 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:18.552197 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d70f9193-c067-4f1d-ac51-51b7ccfdbf61 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Going to try to terminate instance {{(pid=116749) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 09 13:16:18.764651 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 09 13:16:18.764900 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: Wed Feb 9 13:16:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 09 13:16:18.787303 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d70f9193-c067-4f1d-ac51-51b7ccfdbf61 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "DELETE /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 204 len: 0 microversion: 2.20 time: 0.272560 Feb 09 13:16:18.788020 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 353/723] 10.222.0.84 () {60 vars in 1279 bytes} [Wed Feb 9 13:16:18 2022] DELETE /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 09 13:16:18.795973 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-acc50a7f-2ec3-41fb-8400-e68a78c4cb31 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:18.796606 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-acc50a7f-2ec3-41fb-8400-e68a78c4cb31 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:18.803091 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-acc50a7f-2ec3-41fb-8400-e68a78c4cb31 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:18.803540 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-acc50a7f-2ec3-41fb-8400-e68a78c4cb31 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:18.804322 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-acc50a7f-2ec3-41fb-8400-e68a78c4cb31 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:18.804762 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-acc50a7f-2ec3-41fb-8400-e68a78c4cb31 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:18.936623 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-acc50a7f-2ec3-41fb-8400-e68a78c4cb31 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:18.944318 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-acc50a7f-2ec3-41fb-8400-e68a78c4cb31 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:18.945815 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-acc50a7f-2ec3-41fb-8400-e68a78c4cb31 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:18.947040 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-acc50a7f-2ec3-41fb-8400-e68a78c4cb31 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1721 microversion: 2.20 time: 0.154813 Feb 09 13:16:18.947593 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 371/724] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:16:18 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:16:19.966222 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-f87b169a-9ca5-477c-8355-ffd77c0bf7e0 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:19.966958 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-f87b169a-9ca5-477c-8355-ffd77c0bf7e0 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:19.974093 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f87b169a-9ca5-477c-8355-ffd77c0bf7e0 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:19.974574 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f87b169a-9ca5-477c-8355-ffd77c0bf7e0 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:19.975375 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f87b169a-9ca5-477c-8355-ffd77c0bf7e0 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:19.975817 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f87b169a-9ca5-477c-8355-ffd77c0bf7e0 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:20.201472 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-f87b169a-9ca5-477c-8355-ffd77c0bf7e0 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:20.209436 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-f87b169a-9ca5-477c-8355-ffd77c0bf7e0 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:20.210965 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-f87b169a-9ca5-477c-8355-ffd77c0bf7e0 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:20.212161 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-f87b169a-9ca5-477c-8355-ffd77c0bf7e0 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1721 microversion: 2.20 time: 0.250241 Feb 09 13:16:20.212724 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 354/725] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:16:19 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1721 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:16:21.229743 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d041e2d0-3431-478e-9450-c15cc20702fc tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:21.230450 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d041e2d0-3431-478e-9450-c15cc20702fc tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:21.237026 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d041e2d0-3431-478e-9450-c15cc20702fc tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:21.237472 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d041e2d0-3431-478e-9450-c15cc20702fc tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:21.238251 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d041e2d0-3431-478e-9450-c15cc20702fc tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:21.238722 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d041e2d0-3431-478e-9450-c15cc20702fc tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:21.376238 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d041e2d0-3431-478e-9450-c15cc20702fc tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:21.384883 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d041e2d0-3431-478e-9450-c15cc20702fc tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:21.386406 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d041e2d0-3431-478e-9450-c15cc20702fc tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:21.387613 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d041e2d0-3431-478e-9450-c15cc20702fc tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1721 microversion: 2.20 time: 0.161595 Feb 09 13:16:21.388174 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 372/726] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:16:21 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:16:21.691141 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-c93e2e34-f871-4506-ac5b-fbde73701dbd req-cede9f1c-ea68-4dd2-9ef6-0d5416513248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267a95df-7ddb-4e9c-a629-4fc26b9c9843", "name": "network-vif-deleted", "tag": "45e332d3-92b6-4aa9-9b18-a8fa5ca22e31"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:16:21.694160 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:16:21.694160 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:16:21.701754 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-c93e2e34-f871-4506-ac5b-fbde73701dbd req-cede9f1c-ea68-4dd2-9ef6-0d5416513248 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:21.702542 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-c93e2e34-f871-4506-ac5b-fbde73701dbd req-cede9f1c-ea68-4dd2-9ef6-0d5416513248 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:21.714689 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-c93e2e34-f871-4506-ac5b-fbde73701dbd req-cede9f1c-ea68-4dd2-9ef6-0d5416513248 service nova] Creating event network-vif-deleted:45e332d3-92b6-4aa9-9b18-a8fa5ca22e31 for instance 267a95df-7ddb-4e9c-a629-4fc26b9c9843 on hv-cinder-82786 Feb 09 13:16:21.721600 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-c93e2e34-f871-4506-ac5b-fbde73701dbd req-cede9f1c-ea68-4dd2-9ef6-0d5416513248 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033084 Feb 09 13:16:21.721600 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 355/727] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:16:22.407327 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-8f1eefd4-e6a2-407c-9c31-e141462444d2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:22.408061 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-8f1eefd4-e6a2-407c-9c31-e141462444d2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:22.416195 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8f1eefd4-e6a2-407c-9c31-e141462444d2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:22.416621 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8f1eefd4-e6a2-407c-9c31-e141462444d2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:22.417624 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8f1eefd4-e6a2-407c-9c31-e141462444d2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:22.418069 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8f1eefd4-e6a2-407c-9c31-e141462444d2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:22.452232 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8f1eefd4-e6a2-407c-9c31-e141462444d2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:22.454876 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8f1eefd4-e6a2-407c-9c31-e141462444d2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:22.455518 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-8f1eefd4-e6a2-407c-9c31-e141462444d2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lazy-loading 'fault' on Instance uuid 267a95df-7ddb-4e9c-a629-4fc26b9c9843 {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:16:22.500182 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-8f1eefd4-e6a2-407c-9c31-e141462444d2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:22.509403 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-8f1eefd4-e6a2-407c-9c31-e141462444d2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:22.513896 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-8f1eefd4-e6a2-407c-9c31-e141462444d2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:22.513896 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-8f1eefd4-e6a2-407c-9c31-e141462444d2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 200 len: 1369 microversion: 2.20 time: 0.108962 Feb 09 13:16:22.513896 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 373/728] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:16:22 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:16:23.532740 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-2237e004-bfea-49b5-ab66-2f1c66011249 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:23.533513 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-2237e004-bfea-49b5-ab66-2f1c66011249 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:23.545134 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2237e004-bfea-49b5-ab66-2f1c66011249 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:23.545134 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2237e004-bfea-49b5-ab66-2f1c66011249 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:23.545134 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2237e004-bfea-49b5-ab66-2f1c66011249 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:23.545134 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2237e004-bfea-49b5-ab66-2f1c66011249 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:23.560616 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-2237e004-bfea-49b5-ab66-2f1c66011249 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] HTTP exception thrown: Instance 267a95df-7ddb-4e9c-a629-4fc26b9c9843 could not be found. Feb 09 13:16:23.561268 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-2237e004-bfea-49b5-ab66-2f1c66011249 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Returning 404 to user: Instance 267a95df-7ddb-4e9c-a629-4fc26b9c9843 could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:16:23.562092 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-2237e004-bfea-49b5-ab66-2f1c66011249 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 404 len: 111 microversion: 2.20 time: 0.033977 Feb 09 13:16:23.566730 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 356/729] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:16:23 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 09 13:16:23.573582 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-11bb85e6-67ce-40fb-a849-c322990f5bc6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '.version_select at 0x7f7f64538a60>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:23.647661 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-11bb85e6-67ce-40fb-a849-c322990f5bc6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-32048109" status: 204 len: 0 microversion: 2.20 time: 0.077418 Feb 09 13:16:23.647661 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 374/730] 10.222.0.84 () {60 vars in 1255 bytes} [Wed Feb 9 13:16:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-32048109 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 09 13:16:23.712303 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-f15680c0-1799-4313-a368-8497c48921dd tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:23.713342 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-f15680c0-1799-4313-a368-8497c48921dd tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:23.719501 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f15680c0-1799-4313-a368-8497c48921dd tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:23.719961 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f15680c0-1799-4313-a368-8497c48921dd tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:23.720768 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f15680c0-1799-4313-a368-8497c48921dd tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:23.721209 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f15680c0-1799-4313-a368-8497c48921dd tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:23.756422 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-f15680c0-1799-4313-a368-8497c48921dd tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045139 Feb 09 13:16:23.756422 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 357/731] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:16:23 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 09 13:16:23.823009 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-37554677-d038-4eda-8d49-3599b359f446 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:23.823582 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-37554677-d038-4eda-8d49-3599b359f446 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:23.831660 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-37554677-d038-4eda-8d49-3599b359f446 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:23.832190 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-37554677-d038-4eda-8d49-3599b359f446 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:23.833644 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-37554677-d038-4eda-8d49-3599b359f446 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:23.834156 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-37554677-d038-4eda-8d49-3599b359f446 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:23.862962 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-37554677-d038-4eda-8d49-3599b359f446 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Going to try to terminate instance {{(pid=116748) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 09 13:16:24.141944 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-37554677-d038-4eda-8d49-3599b359f446 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "DELETE /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 204 len: 0 microversion: 2.1 time: 0.322441 Feb 09 13:16:24.143189 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 375/732] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:16:23 2022] DELETE /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 09 13:16:24.151554 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-53130409-47b7-4af9-9c1c-1226f82cc904 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:24.152155 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-53130409-47b7-4af9-9c1c-1226f82cc904 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:24.163854 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-53130409-47b7-4af9-9c1c-1226f82cc904 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:24.164815 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-53130409-47b7-4af9-9c1c-1226f82cc904 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:24.165911 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-53130409-47b7-4af9-9c1c-1226f82cc904 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:24.166655 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-53130409-47b7-4af9-9c1c-1226f82cc904 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:24.355100 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-53130409-47b7-4af9-9c1c-1226f82cc904 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:24.362923 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-53130409-47b7-4af9-9c1c-1226f82cc904 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1675 microversion: 2.1 time: 0.215247 Feb 09 13:16:24.363711 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 358/733] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:24 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1675 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:16:24.398699 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-7014c685-4e4b-46d6-ab70-bb1af6311252 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2014828370"}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:16:24.400256 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-7014c685-4e4b-46d6-ab70-bb1af6311252 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:24.412002 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7014c685-4e4b-46d6-ab70-bb1af6311252 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:24.413037 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7014c685-4e4b-46d6-ab70-bb1af6311252 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:24.414702 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7014c685-4e4b-46d6-ab70-bb1af6311252 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:24.415633 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7014c685-4e4b-46d6-ab70-bb1af6311252 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:24.555824 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-196745a3-2ecf-47b0-b8f9-3bfcf9983856 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Action: 'create', calling method: .version_select at 0x7f7f64ed8dc0>, body: {"keypair": {"name": "tempest-keypair-60412431"}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:16:24.579625 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-196745a3-2ecf-47b0-b8f9-3bfcf9983856 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Getting quotas for project dd4edb9e42144956ae9a0a0f8c99bb71. Resources: {'key_pairs'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:16:24.585244 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-196745a3-2ecf-47b0-b8f9-3bfcf9983856 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Getting quotas for user 58dc0b9f64334ecb9a325e6511786a61 and project dd4edb9e42144956ae9a0a0f8c99bb71. Resources: {'key_pairs'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:16:24.618583 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.network.security_group_api [None req-7014c685-4e4b-46d6-ab70-bb1af6311252 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Removing security group a0eb802f-205e-47fe-8ac4-b59f1049a4ae from port aa6d2832-0830-44ab-bdba-ad1e71f0308b Feb 09 13:16:24.831486 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-196745a3-2ecf-47b0-b8f9-3bfcf9983856 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Getting quotas for project dd4edb9e42144956ae9a0a0f8c99bb71. Resources: {'key_pairs'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:16:24.835204 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-196745a3-2ecf-47b0-b8f9-3bfcf9983856 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Getting quotas for user 58dc0b9f64334ecb9a325e6511786a61 and project dd4edb9e42144956ae9a0a0f8c99bb71. Resources: {'key_pairs'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:16:24.847955 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-196745a3-2ecf-47b0-b8f9-3bfcf9983856 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 201 len: 2314 microversion: 2.20 time: 0.298782 Feb 09 13:16:24.852330 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 359/734] 10.222.0.84 () {62 vars in 1198 bytes} [Wed Feb 9 13:16:24 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 300 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Feb 09 13:16:25.027183 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-7014c685-4e4b-46d6-ab70-bb1af6311252 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "POST /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618/action" status: 202 len: 0 microversion: 2.1 time: 0.637533 Feb 09 13:16:25.031065 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 376/735] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Feb 9 13:16:24 2022] POST /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618/action => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:16:25.037772 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-c2a7fb01-08d4-408e-8a76-6db963453469 req-15a09add-b33a-4ebd-88fc-e2ff92461e0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982d841e-c5c6-44a9-9982-44f8cc31b618", "tag": "aa6d2832-0830-44ab-bdba-ad1e71f0308b"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:16:25.040916 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:16:25.040916 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:16:25.054533 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-c2a7fb01-08d4-408e-8a76-6db963453469 req-15a09add-b33a-4ebd-88fc-e2ff92461e0a service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:25.055321 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-c2a7fb01-08d4-408e-8a76-6db963453469 req-15a09add-b33a-4ebd-88fc-e2ff92461e0a service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:25.076245 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-c2a7fb01-08d4-408e-8a76-6db963453469 req-15a09add-b33a-4ebd-88fc-e2ff92461e0a service nova] Creating event network-changed:aa6d2832-0830-44ab-bdba-ad1e71f0308b for instance 982d841e-c5c6-44a9-9982-44f8cc31b618 on hv-cinder-82786 Feb 09 13:16:25.083417 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-c2a7fb01-08d4-408e-8a76-6db963453469 req-15a09add-b33a-4ebd-88fc-e2ff92461e0a service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052729 Feb 09 13:16:25.084254 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 360/736] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:16:25.381464 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-1fdaf92d-8304-4846-bfa6-7f88dc1dafab tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:25.383020 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-1fdaf92d-8304-4846-bfa6-7f88dc1dafab tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:25.395928 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1fdaf92d-8304-4846-bfa6-7f88dc1dafab tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:25.396833 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1fdaf92d-8304-4846-bfa6-7f88dc1dafab tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:25.397969 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1fdaf92d-8304-4846-bfa6-7f88dc1dafab tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:25.399081 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1fdaf92d-8304-4846-bfa6-7f88dc1dafab tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:25.607695 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-1fdaf92d-8304-4846-bfa6-7f88dc1dafab tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:25.616026 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-1fdaf92d-8304-4846-bfa6-7f88dc1dafab tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1675 microversion: 2.1 time: 0.238859 Feb 09 13:16:25.616699 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 377/737] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:25 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1675 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:16:26.634659 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-e344f584-2c57-478f-9932-3f2d5a37b03b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:26.635991 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-e344f584-2c57-478f-9932-3f2d5a37b03b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:26.646352 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e344f584-2c57-478f-9932-3f2d5a37b03b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:26.646842 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e344f584-2c57-478f-9932-3f2d5a37b03b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:26.647636 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e344f584-2c57-478f-9932-3f2d5a37b03b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:26.648066 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e344f584-2c57-478f-9932-3f2d5a37b03b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:26.986770 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-e344f584-2c57-478f-9932-3f2d5a37b03b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:26.996442 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-e344f584-2c57-478f-9932-3f2d5a37b03b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1675 microversion: 2.1 time: 0.366826 Feb 09 13:16:26.997345 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 361/738] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:26 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1675 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:16:27.141467 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-71c40bb9-7dab-4b1c-a608-9ae96eb93a90 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:27.141981 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-71c40bb9-7dab-4b1c-a608-9ae96eb93a90 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:27.146593 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-2579ea78-fb3d-4444-991f-604472a8beaa req-c501b257-7dcd-4527-921e-0c6b63798e53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982d841e-c5c6-44a9-9982-44f8cc31b618", "tag": "aa6d2832-0830-44ab-bdba-ad1e71f0308b"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:16:27.149658 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-71c40bb9-7dab-4b1c-a608-9ae96eb93a90 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:27.150118 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-71c40bb9-7dab-4b1c-a608-9ae96eb93a90 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:27.151282 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-71c40bb9-7dab-4b1c-a608-9ae96eb93a90 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:27.153181 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-71c40bb9-7dab-4b1c-a608-9ae96eb93a90 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:27.154201 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:16:27.154201 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:16:27.166529 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-2579ea78-fb3d-4444-991f-604472a8beaa req-c501b257-7dcd-4527-921e-0c6b63798e53 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:27.167323 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-2579ea78-fb3d-4444-991f-604472a8beaa req-c501b257-7dcd-4527-921e-0c6b63798e53 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:27.185378 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-2579ea78-fb3d-4444-991f-604472a8beaa req-c501b257-7dcd-4527-921e-0c6b63798e53 service nova] Creating event network-changed:aa6d2832-0830-44ab-bdba-ad1e71f0308b for instance 982d841e-c5c6-44a9-9982-44f8cc31b618 on hv-cinder-82786 Feb 09 13:16:27.192160 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-2579ea78-fb3d-4444-991f-604472a8beaa req-c501b257-7dcd-4527-921e-0c6b63798e53 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050711 Feb 09 13:16:27.193666 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 362/739] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:16:27.251960 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-03a04cb8-3560-4497-ba78-69137be62b51 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-567424293", "imageRef": "af86cedd-e7d5-4a28-a810-f47830f4bffc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a32947b8-36d8-4e31-8400-b282b6379a3d"}], "security_groups": [{"name": "tempest-securitygroup--2022350861"}], "key_name": "tempest-keypair-60412431", "user_data": "}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:16:27.261110 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-71c40bb9-7dab-4b1c-a608-9ae96eb93a90 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lazy-loading 'services' on Instance uuid 982d841e-c5c6-44a9-9982-44f8cc31b618 {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:16:27.475436 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.network.neutron [None req-03a04cb8-3560-4497-ba78-69137be62b51 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] validate_networks() for [('a32947b8-36d8-4e31-8400-b282b6379a3d', None, None, None, None, None)] {{(pid=116749) validate_networks /opt/stack/nova/nova/network/neutron.py:2554}} Feb 09 13:16:27.508889 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-71c40bb9-7dab-4b1c-a608-9ae96eb93a90 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "DELETE /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618/os-volume_attachments/5c3b8eb9-9eb3-44e6-a942-06aa8611f155" status: 202 len: 0 microversion: 2.1 time: 0.371427 Feb 09 13:16:27.511159 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 378/740] 10.222.0.84 () {58 vars in 1415 bytes} [Wed Feb 9 13:16:27 2022] DELETE /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618/os-volume_attachments/5c3b8eb9-9eb3-44e6-a942-06aa8611f155 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:16:27.521016 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-7bb7969d-a168-4783-b39d-afeaf79fc2f8 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:27.522469 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-7bb7969d-a168-4783-b39d-afeaf79fc2f8 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:27.529805 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7bb7969d-a168-4783-b39d-afeaf79fc2f8 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:27.530928 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7bb7969d-a168-4783-b39d-afeaf79fc2f8 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:27.531944 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7bb7969d-a168-4783-b39d-afeaf79fc2f8 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:27.532568 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7bb7969d-a168-4783-b39d-afeaf79fc2f8 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:27.565889 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-7bb7969d-a168-4783-b39d-afeaf79fc2f8 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050277 Feb 09 13:16:27.566687 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 379/741] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:16:27 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:16:28.014377 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-981c9305-7bd4-4379-bbfd-e6531dc85f6f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:28.015334 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-981c9305-7bd4-4379-bbfd-e6531dc85f6f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:28.022738 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-981c9305-7bd4-4379-bbfd-e6531dc85f6f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:28.023281 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-981c9305-7bd4-4379-bbfd-e6531dc85f6f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:28.024172 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-981c9305-7bd4-4379-bbfd-e6531dc85f6f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:28.024687 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-981c9305-7bd4-4379-bbfd-e6531dc85f6f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:28.095417 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-981c9305-7bd4-4379-bbfd-e6531dc85f6f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:28.103851 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-981c9305-7bd4-4379-bbfd-e6531dc85f6f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1607 microversion: 2.1 time: 0.092992 Feb 09 13:16:28.104541 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 380/742] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:28 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1607 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:16:28.495657 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-03a04cb8-3560-4497-ba78-69137be62b51 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Flavor limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 09 13:16:28.496157 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-03a04cb8-3560-4497-ba78-69137be62b51 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Image limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 09 13:16:28.496652 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-03a04cb8-3560-4497-ba78-69137be62b51 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Flavor pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 09 13:16:28.497239 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-03a04cb8-3560-4497-ba78-69137be62b51 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Image pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 09 13:16:28.497647 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-03a04cb8-3560-4497-ba78-69137be62b51 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 09 13:16:28.534209 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-03a04cb8-3560-4497-ba78-69137be62b51 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:28.534688 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-03a04cb8-3560-4497-ba78-69137be62b51 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:28.535606 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-03a04cb8-3560-4497-ba78-69137be62b51 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:28.536071 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-03a04cb8-3560-4497-ba78-69137be62b51 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:28.565366 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-03a04cb8-3560-4497-ba78-69137be62b51 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Getting quotas for project dd4edb9e42144956ae9a0a0f8c99bb71. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:16:28.570406 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-03a04cb8-3560-4497-ba78-69137be62b51 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Getting quotas for user 58dc0b9f64334ecb9a325e6511786a61 and project dd4edb9e42144956ae9a0a0f8c99bb71. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:16:28.578824 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-2de25796-05c4-4f30-b067-d7a6e672bcb4 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:28.580345 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-2de25796-05c4-4f30-b067-d7a6e672bcb4 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:28.582303 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-03a04cb8-3560-4497-ba78-69137be62b51 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Going to run 1 instances... {{(pid=116749) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 09 13:16:28.586752 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-03a04cb8-3560-4497-ba78-69137be62b51 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af86cedd-e7d5-4a28-a810-f47830f4bffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 09 13:16:28.587251 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2de25796-05c4-4f30-b067-d7a6e672bcb4 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:28.587773 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2de25796-05c4-4f30-b067-d7a6e672bcb4 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:28.588651 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2de25796-05c4-4f30-b067-d7a6e672bcb4 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:28.589161 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2de25796-05c4-4f30-b067-d7a6e672bcb4 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:28.620131 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-2de25796-05c4-4f30-b067-d7a6e672bcb4 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044956 Feb 09 13:16:28.621085 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 381/743] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:16:28 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:16:28.761632 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-03a04cb8-3560-4497-ba78-69137be62b51 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.514438 Feb 09 13:16:28.762295 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 363/744] 10.222.0.84 () {62 vars in 1187 bytes} [Wed Feb 9 13:16:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1516 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 09 13:16:28.772914 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-f42f2bed-2afc-4083-a986-6679b6973386 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:28.773522 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-f42f2bed-2afc-4083-a986-6679b6973386 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:28.852036 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f42f2bed-2afc-4083-a986-6679b6973386 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:28.860390 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f42f2bed-2afc-4083-a986-6679b6973386 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:28.862426 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f42f2bed-2afc-4083-a986-6679b6973386 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:28.864938 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-f42f2bed-2afc-4083-a986-6679b6973386 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1279 microversion: 2.20 time: 0.096011 Feb 09 13:16:28.866145 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 382/745] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:16:28 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1279 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:16:29.121427 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-13046aa4-ce53-4aaf-814c-9209868b419d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:29.122052 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-13046aa4-ce53-4aaf-814c-9209868b419d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:29.129391 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-13046aa4-ce53-4aaf-814c-9209868b419d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:29.129846 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-13046aa4-ce53-4aaf-814c-9209868b419d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:29.130684 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-13046aa4-ce53-4aaf-814c-9209868b419d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:29.131132 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-13046aa4-ce53-4aaf-814c-9209868b419d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:29.162396 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-13046aa4-ce53-4aaf-814c-9209868b419d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:29.162828 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-13046aa4-ce53-4aaf-814c-9209868b419d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:29.163288 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.objects.instance [None req-13046aa4-ce53-4aaf-814c-9209868b419d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lazy-loading 'fault' on Instance uuid 7d2bee05-65c9-445a-a7ca-98808614d991 {{(pid=116749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:16:29.204061 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-13046aa4-ce53-4aaf-814c-9209868b419d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:29.212033 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-13046aa4-ce53-4aaf-814c-9209868b419d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 200 len: 1328 microversion: 2.1 time: 0.094369 Feb 09 13:16:29.212654 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 364/746] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:29 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 1328 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:16:29.228987 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-f3ffed64-f036-4824-99bc-3f181d382d26 req-2f83d006-6b1f-454a-b13a-4207038e30e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d2bee05-65c9-445a-a7ca-98808614d991", "name": "network-vif-deleted", "tag": "0a218b4e-3337-4b9d-9226-b484077f2606"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:16:29.230633 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:16:29.230633 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:16:29.239679 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-f3ffed64-f036-4824-99bc-3f181d382d26 req-2f83d006-6b1f-454a-b13a-4207038e30e0 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:29.240126 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-f3ffed64-f036-4824-99bc-3f181d382d26 req-2f83d006-6b1f-454a-b13a-4207038e30e0 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:29.250285 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-f3ffed64-f036-4824-99bc-3f181d382d26 req-2f83d006-6b1f-454a-b13a-4207038e30e0 service nova] Creating event network-vif-deleted:0a218b4e-3337-4b9d-9226-b484077f2606 for instance 7d2bee05-65c9-445a-a7ca-98808614d991 on hv-cinder-82786 Feb 09 13:16:29.255027 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-f3ffed64-f036-4824-99bc-3f181d382d26 req-2f83d006-6b1f-454a-b13a-4207038e30e0 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029702 Feb 09 13:16:29.255622 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 383/747] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:16:29.635092 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-5b7e7058-7b83-4dbd-9ed6-ab8f8ff68536 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:29.636155 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-5b7e7058-7b83-4dbd-9ed6-ab8f8ff68536 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:29.646354 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5b7e7058-7b83-4dbd-9ed6-ab8f8ff68536 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:29.646855 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5b7e7058-7b83-4dbd-9ed6-ab8f8ff68536 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:29.647660 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5b7e7058-7b83-4dbd-9ed6-ab8f8ff68536 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:29.648095 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5b7e7058-7b83-4dbd-9ed6-ab8f8ff68536 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:29.681774 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-5b7e7058-7b83-4dbd-9ed6-ab8f8ff68536 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053476 Feb 09 13:16:29.682339 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 365/748] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:16:29 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 09 13:16:29.693877 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-caf34e37-61b5-4ae8-93a1-0736d6daa4e6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:29.694459 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-caf34e37-61b5-4ae8-93a1-0736d6daa4e6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:29.704242 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-caf34e37-61b5-4ae8-93a1-0736d6daa4e6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:29.704700 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-caf34e37-61b5-4ae8-93a1-0736d6daa4e6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:29.705508 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-caf34e37-61b5-4ae8-93a1-0736d6daa4e6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:29.706133 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-caf34e37-61b5-4ae8-93a1-0736d6daa4e6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:29.784807 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.wsgi [None req-caf34e37-61b5-4ae8-93a1-0736d6daa4e6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] HTTP exception thrown: Instance 982d841e-c5c6-44a9-9982-44f8cc31b618 is not attached to volume 5c3b8eb9-9eb3-44e6-a942-06aa8611f155 Feb 09 13:16:29.785965 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-caf34e37-61b5-4ae8-93a1-0736d6daa4e6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Returning 404 to user: Instance 982d841e-c5c6-44a9-9982-44f8cc31b618 is not attached to volume 5c3b8eb9-9eb3-44e6-a942-06aa8611f155 {{(pid=116748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:16:29.786915 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-caf34e37-61b5-4ae8-93a1-0736d6daa4e6 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "DELETE /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618/os-volume_attachments/5c3b8eb9-9eb3-44e6-a942-06aa8611f155" status: 404 len: 154 microversion: 2.1 time: 0.098435 Feb 09 13:16:29.787489 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 384/749] 10.222.0.84 () {58 vars in 1415 bytes} [Wed Feb 9 13:16:29 2022] DELETE /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618/os-volume_attachments/5c3b8eb9-9eb3-44e6-a942-06aa8611f155 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:16:29.883599 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8f67c7b3-48a2-4f23-bc11-37d22936d131 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:29.884195 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8f67c7b3-48a2-4f23-bc11-37d22936d131 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:29.890082 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8f67c7b3-48a2-4f23-bc11-37d22936d131 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:29.890608 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8f67c7b3-48a2-4f23-bc11-37d22936d131 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:29.891433 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8f67c7b3-48a2-4f23-bc11-37d22936d131 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:29.891897 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8f67c7b3-48a2-4f23-bc11-37d22936d131 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:29.952484 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8f67c7b3-48a2-4f23-bc11-37d22936d131 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:29.960925 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8f67c7b3-48a2-4f23-bc11-37d22936d131 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:29.962473 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8f67c7b3-48a2-4f23-bc11-37d22936d131 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:29.963604 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8f67c7b3-48a2-4f23-bc11-37d22936d131 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1283 microversion: 2.20 time: 0.083832 Feb 09 13:16:29.964169 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 366/750] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:16:29 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1283 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:16:30.230906 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-307ccaaf-70f2-48c3-beee-638d6927d248 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:30.235604 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-307ccaaf-70f2-48c3-beee-638d6927d248 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:30.237344 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-307ccaaf-70f2-48c3-beee-638d6927d248 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:30.237793 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-307ccaaf-70f2-48c3-beee-638d6927d248 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:30.238590 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-307ccaaf-70f2-48c3-beee-638d6927d248 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:30.239033 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-307ccaaf-70f2-48c3-beee-638d6927d248 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:30.253714 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.wsgi [None req-307ccaaf-70f2-48c3-beee-638d6927d248 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] HTTP exception thrown: Instance 7d2bee05-65c9-445a-a7ca-98808614d991 could not be found. Feb 09 13:16:30.254837 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-307ccaaf-70f2-48c3-beee-638d6927d248 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Returning 404 to user: Instance 7d2bee05-65c9-445a-a7ca-98808614d991 could not be found. {{(pid=116748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:16:30.255653 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-307ccaaf-70f2-48c3-beee-638d6927d248 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 404 len: 111 microversion: 2.1 time: 0.028508 Feb 09 13:16:30.256192 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 385/751] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:30 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:16:30.265538 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-6ad8a4a1-0c1a-4c73-b58a-e220aabff8db tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '.version_select at 0x7f7f64f84e50>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:30.365692 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-6ad8a4a1-0c1a-4c73-b58a-e220aabff8db tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046216498" status: 202 len: 0 microversion: 2.1 time: 0.104575 Feb 09 13:16:30.366270 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 367/752] 10.222.0.84 () {58 vars in 1220 bytes} [Wed Feb 9 13:16:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046216498 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:16:30.980953 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-73dc4cb0-0287-4966-8960-6fe4e5a8f6f2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:30.982186 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-73dc4cb0-0287-4966-8960-6fe4e5a8f6f2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:30.988246 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-73dc4cb0-0287-4966-8960-6fe4e5a8f6f2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:30.989310 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-73dc4cb0-0287-4966-8960-6fe4e5a8f6f2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:30.990103 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-73dc4cb0-0287-4966-8960-6fe4e5a8f6f2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:30.990540 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-73dc4cb0-0287-4966-8960-6fe4e5a8f6f2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:31.055912 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-73dc4cb0-0287-4966-8960-6fe4e5a8f6f2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:31.068866 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-73dc4cb0-0287-4966-8960-6fe4e5a8f6f2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:31.068866 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-73dc4cb0-0287-4966-8960-6fe4e5a8f6f2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:31.068866 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-73dc4cb0-0287-4966-8960-6fe4e5a8f6f2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1331 microversion: 2.20 time: 0.090240 Feb 09 13:16:31.077633 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 386/753] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:16:30 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:16:31.082746 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-a60d55ae-4d37-446a-86ac-c2da463d1533 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:31.083269 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-a60d55ae-4d37-446a-86ac-c2da463d1533 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:31.090465 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a60d55ae-4d37-446a-86ac-c2da463d1533 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:31.091088 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a60d55ae-4d37-446a-86ac-c2da463d1533 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:31.091925 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a60d55ae-4d37-446a-86ac-c2da463d1533 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:31.092361 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a60d55ae-4d37-446a-86ac-c2da463d1533 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:31.120793 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-a60d55ae-4d37-446a-86ac-c2da463d1533 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Going to try to terminate instance {{(pid=116749) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 09 13:16:31.421265 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-a60d55ae-4d37-446a-86ac-c2da463d1533 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "DELETE /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 204 len: 0 microversion: 2.1 time: 0.342186 Feb 09 13:16:31.426861 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 368/754] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:16:31 2022] DELETE /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 09 13:16:31.431184 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-f6f62e01-0091-4ae8-ad8f-2bd3a865b934 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:31.431820 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-f6f62e01-0091-4ae8-ad8f-2bd3a865b934 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:31.438185 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-067c592b-9cfe-42a5-b735-477a0c8e433a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Action: 'create', calling method: .version_select at 0x7f7f64efd1f0>, body: {"keypair": {"name": "tempest-keypair-1894228934"}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:16:31.440223 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f6f62e01-0091-4ae8-ad8f-2bd3a865b934 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:31.441255 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f6f62e01-0091-4ae8-ad8f-2bd3a865b934 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:31.442899 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f6f62e01-0091-4ae8-ad8f-2bd3a865b934 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:31.443568 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f6f62e01-0091-4ae8-ad8f-2bd3a865b934 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:31.456013 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-067c592b-9cfe-42a5-b735-477a0c8e433a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Getting quotas for project 413094dda74649c282bf36d27168fc96. Resources: {'key_pairs'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:16:31.460318 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-067c592b-9cfe-42a5-b735-477a0c8e433a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Getting quotas for user 0cdb5b8deadf447da675e9a24395a82f and project 413094dda74649c282bf36d27168fc96. Resources: {'key_pairs'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:16:31.587244 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f6f62e01-0091-4ae8-ad8f-2bd3a865b934 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:31.592742 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-f6f62e01-0091-4ae8-ad8f-2bd3a865b934 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1554 microversion: 2.1 time: 0.165647 Feb 09 13:16:31.593525 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 387/755] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:31 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:16:31.694694 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-067c592b-9cfe-42a5-b735-477a0c8e433a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Getting quotas for project 413094dda74649c282bf36d27168fc96. Resources: {'key_pairs'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:16:31.698332 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-067c592b-9cfe-42a5-b735-477a0c8e433a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Getting quotas for user 0cdb5b8deadf447da675e9a24395a82f and project 413094dda74649c282bf36d27168fc96. Resources: {'key_pairs'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:16:31.711336 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-067c592b-9cfe-42a5-b735-477a0c8e433a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.278347 Feb 09 13:16:31.712081 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 369/756] 10.222.0.84 () {60 vars in 1157 bytes} [Wed Feb 9 13:16:31 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:16:32.089282 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-6926336f-4a4a-40d1-9e7f-8f743a88b4ef tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:32.090035 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-6926336f-4a4a-40d1-9e7f-8f743a88b4ef tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:32.096927 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6926336f-4a4a-40d1-9e7f-8f743a88b4ef tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:32.097379 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6926336f-4a4a-40d1-9e7f-8f743a88b4ef tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:32.098792 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6926336f-4a4a-40d1-9e7f-8f743a88b4ef tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:32.099270 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6926336f-4a4a-40d1-9e7f-8f743a88b4ef tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:32.168264 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6926336f-4a4a-40d1-9e7f-8f743a88b4ef tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:32.177615 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6926336f-4a4a-40d1-9e7f-8f743a88b4ef tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:32.179092 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6926336f-4a4a-40d1-9e7f-8f743a88b4ef tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:32.180204 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-6926336f-4a4a-40d1-9e7f-8f743a88b4ef tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1337 microversion: 2.20 time: 0.094986 Feb 09 13:16:32.180770 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 388/757] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:16:32 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1337 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:16:32.610360 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-af99041f-ed2e-49d6-9aaa-4ac93e3ee930 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:32.611702 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-af99041f-ed2e-49d6-9aaa-4ac93e3ee930 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:32.619000 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-af99041f-ed2e-49d6-9aaa-4ac93e3ee930 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:32.619696 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-af99041f-ed2e-49d6-9aaa-4ac93e3ee930 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:32.620650 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-af99041f-ed2e-49d6-9aaa-4ac93e3ee930 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:32.621091 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-af99041f-ed2e-49d6-9aaa-4ac93e3ee930 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:32.814621 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-af99041f-ed2e-49d6-9aaa-4ac93e3ee930 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:32.822654 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-af99041f-ed2e-49d6-9aaa-4ac93e3ee930 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1554 microversion: 2.1 time: 0.216692 Feb 09 13:16:32.823227 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 370/758] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:32 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1554 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:16:33.198223 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ab4a9ea6-c79a-45e3-a4fd-0073e4073def tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:33.198628 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-ab4a9ea6-c79a-45e3-a4fd-0073e4073def tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:33.206596 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ab4a9ea6-c79a-45e3-a4fd-0073e4073def tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:33.207503 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ab4a9ea6-c79a-45e3-a4fd-0073e4073def tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:33.208314 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ab4a9ea6-c79a-45e3-a4fd-0073e4073def tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:33.208950 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ab4a9ea6-c79a-45e3-a4fd-0073e4073def tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:33.306486 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-5f720924-bec0-4977-a487-673f7b6d412d req-90723afa-3870-43e4-bcdb-1a6c2de5e9cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ece0c49e-784a-49c1-85c1-de2a95a93e00", "tag": "8fc972e9-0cc0-429d-a82a-fd959fe8f9d3"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:16:33.308285 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:16:33.308285 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:16:33.316234 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-5f720924-bec0-4977-a487-673f7b6d412d req-90723afa-3870-43e4-bcdb-1a6c2de5e9cf service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:33.316940 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-5f720924-bec0-4977-a487-673f7b6d412d req-90723afa-3870-43e4-bcdb-1a6c2de5e9cf service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:33.330505 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-5f720924-bec0-4977-a487-673f7b6d412d req-90723afa-3870-43e4-bcdb-1a6c2de5e9cf service nova] Creating event network-changed:8fc972e9-0cc0-429d-a82a-fd959fe8f9d3 for instance ece0c49e-784a-49c1-85c1-de2a95a93e00 on hv-cinder-82786 Feb 09 13:16:33.344255 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-5f720924-bec0-4977-a487-673f7b6d412d req-90723afa-3870-43e4-bcdb-1a6c2de5e9cf service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155742 Feb 09 13:16:33.345554 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 389/759] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:16:33.448599 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ab4a9ea6-c79a-45e3-a4fd-0073e4073def tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:33.456889 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ab4a9ea6-c79a-45e3-a4fd-0073e4073def tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:33.458386 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ab4a9ea6-c79a-45e3-a4fd-0073e4073def tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:33.459704 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-ab4a9ea6-c79a-45e3-a4fd-0073e4073def tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1405 microversion: 2.20 time: 0.265837 Feb 09 13:16:33.460260 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 371/760] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:16:33 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:16:33.842628 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-739c6746-1243-4c26-900b-b2490601c92c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:33.843628 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-739c6746-1243-4c26-900b-b2490601c92c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:33.852455 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-739c6746-1243-4c26-900b-b2490601c92c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:33.853159 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-739c6746-1243-4c26-900b-b2490601c92c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:33.854159 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-739c6746-1243-4c26-900b-b2490601c92c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:33.854621 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-739c6746-1243-4c26-900b-b2490601c92c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:33.975079 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-4279ff11-1b2b-409f-ae92-31558c493301 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1563877449", "imageRef": "af86cedd-e7d5-4a28-a810-f47830f4bffc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ce67157-f48b-4d2d-b32c-6a12d5e26c1b"}], "security_groups": [{"name": "tempest-securitygroup--1159581679"}], "key_name": "tempest-keypair-1894228934", "user_data": "}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:16:34.003331 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-739c6746-1243-4c26-900b-b2490601c92c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:34.012198 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-739c6746-1243-4c26-900b-b2490601c92c tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1554 microversion: 2.1 time: 0.176170 Feb 09 13:16:34.013011 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 390/761] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:33 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:16:34.144439 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.network.neutron [None req-4279ff11-1b2b-409f-ae92-31558c493301 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] validate_networks() for [('9ce67157-f48b-4d2d-b32c-6a12d5e26c1b', None, None, None, None, None)] {{(pid=116749) validate_networks /opt/stack/nova/nova/network/neutron.py:2554}} Feb 09 13:16:34.477228 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-e404d66e-50f8-480c-9e93-3c906e258373 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:34.477901 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-e404d66e-50f8-480c-9e93-3c906e258373 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:34.484747 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e404d66e-50f8-480c-9e93-3c906e258373 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:34.485209 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e404d66e-50f8-480c-9e93-3c906e258373 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:34.486058 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e404d66e-50f8-480c-9e93-3c906e258373 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:34.486520 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e404d66e-50f8-480c-9e93-3c906e258373 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:34.625473 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e404d66e-50f8-480c-9e93-3c906e258373 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:34.633972 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e404d66e-50f8-480c-9e93-3c906e258373 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:34.635934 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e404d66e-50f8-480c-9e93-3c906e258373 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:34.638152 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-e404d66e-50f8-480c-9e93-3c906e258373 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1405 microversion: 2.20 time: 0.163802 Feb 09 13:16:34.638530 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 391/762] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:16:34 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:16:34.845942 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-4279ff11-1b2b-409f-ae92-31558c493301 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Flavor limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 09 13:16:34.846363 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-4279ff11-1b2b-409f-ae92-31558c493301 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Image limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 09 13:16:34.846866 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-4279ff11-1b2b-409f-ae92-31558c493301 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Flavor pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 09 13:16:34.847276 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-4279ff11-1b2b-409f-ae92-31558c493301 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Image pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 09 13:16:34.848221 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-4279ff11-1b2b-409f-ae92-31558c493301 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 09 13:16:34.856779 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4279ff11-1b2b-409f-ae92-31558c493301 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:34.857231 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4279ff11-1b2b-409f-ae92-31558c493301 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:34.858048 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4279ff11-1b2b-409f-ae92-31558c493301 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:34.858486 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4279ff11-1b2b-409f-ae92-31558c493301 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:34.875264 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-4279ff11-1b2b-409f-ae92-31558c493301 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Getting quotas for project 413094dda74649c282bf36d27168fc96. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:16:34.879238 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-4279ff11-1b2b-409f-ae92-31558c493301 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Getting quotas for user 0cdb5b8deadf447da675e9a24395a82f and project 413094dda74649c282bf36d27168fc96. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:16:34.889748 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-4279ff11-1b2b-409f-ae92-31558c493301 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Going to run 1 instances... {{(pid=116749) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 09 13:16:34.892160 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-4279ff11-1b2b-409f-ae92-31558c493301 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af86cedd-e7d5-4a28-a810-f47830f4bffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 09 13:16:35.028137 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-4279ff11-1b2b-409f-ae92-31558c493301 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.058132 Feb 09 13:16:35.029075 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 372/763] 10.222.0.84 () {60 vars in 1146 bytes} [Wed Feb 9 13:16:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 09 13:16:35.030652 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-2e2c8098-831d-4837-a7ba-b4233328fba4 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:35.031276 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-2e2c8098-831d-4837-a7ba-b4233328fba4 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:35.038114 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2e2c8098-831d-4837-a7ba-b4233328fba4 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:35.038653 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2e2c8098-831d-4837-a7ba-b4233328fba4 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:35.039467 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2e2c8098-831d-4837-a7ba-b4233328fba4 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:35.039731 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-26e770a6-bdbd-425b-b696-91dba513b2bb tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:35.039911 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2e2c8098-831d-4837-a7ba-b4233328fba4 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:35.040350 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-26e770a6-bdbd-425b-b696-91dba513b2bb tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:35.088714 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2e2c8098-831d-4837-a7ba-b4233328fba4 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:35.089343 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2e2c8098-831d-4837-a7ba-b4233328fba4 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:35.089822 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-2e2c8098-831d-4837-a7ba-b4233328fba4 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lazy-loading 'fault' on Instance uuid 982d841e-c5c6-44a9-9982-44f8cc31b618 {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:16:35.106524 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-26e770a6-bdbd-425b-b696-91dba513b2bb tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:35.113237 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-26e770a6-bdbd-425b-b696-91dba513b2bb tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2" status: 200 len: 1238 microversion: 2.1 time: 0.077903 Feb 09 13:16:35.114048 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 373/764] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:35 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2 => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:16:35.141231 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-2e2c8098-831d-4837-a7ba-b4233328fba4 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1964ee70c93404fbaec3cf03672d364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac777728da844e3a91e4d65d4aa9e4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:35.149262 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-2e2c8098-831d-4837-a7ba-b4233328fba4 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 200 len: 1347 microversion: 2.1 time: 0.122416 Feb 09 13:16:35.149842 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 392/765] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:35 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 1347 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:16:35.364340 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-2690d7f5-1bf8-4cf5-a53f-56270c2fbe85 req-1008b638-c33f-44a1-9e84-e83785aceccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982d841e-c5c6-44a9-9982-44f8cc31b618", "name": "network-vif-deleted", "tag": "aa6d2832-0830-44ab-bdba-ad1e71f0308b"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:16:35.365923 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:16:35.365923 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:16:35.372765 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-2690d7f5-1bf8-4cf5-a53f-56270c2fbe85 req-1008b638-c33f-44a1-9e84-e83785aceccf service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:35.379903 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-2690d7f5-1bf8-4cf5-a53f-56270c2fbe85 req-1008b638-c33f-44a1-9e84-e83785aceccf service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:35.383552 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-2690d7f5-1bf8-4cf5-a53f-56270c2fbe85 req-1008b638-c33f-44a1-9e84-e83785aceccf service nova] Creating event network-vif-deleted:aa6d2832-0830-44ab-bdba-ad1e71f0308b for instance 982d841e-c5c6-44a9-9982-44f8cc31b618 on hv-cinder-82786 Feb 09 13:16:35.388222 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-2690d7f5-1bf8-4cf5-a53f-56270c2fbe85 req-1008b638-c33f-44a1-9e84-e83785aceccf service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027585 Feb 09 13:16:35.388798 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 374/766] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:16:35.654846 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-c552e1c3-bd10-42af-95c6-6d4256132e7d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:35.655452 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-c552e1c3-bd10-42af-95c6-6d4256132e7d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:35.661764 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c552e1c3-bd10-42af-95c6-6d4256132e7d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:35.669792 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c552e1c3-bd10-42af-95c6-6d4256132e7d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:35.669792 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c552e1c3-bd10-42af-95c6-6d4256132e7d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:35.669792 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c552e1c3-bd10-42af-95c6-6d4256132e7d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:35.795792 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-c552e1c3-bd10-42af-95c6-6d4256132e7d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:35.804756 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-c552e1c3-bd10-42af-95c6-6d4256132e7d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:35.806320 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-c552e1c3-bd10-42af-95c6-6d4256132e7d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:35.807466 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-c552e1c3-bd10-42af-95c6-6d4256132e7d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1405 microversion: 2.20 time: 0.156612 Feb 09 13:16:35.808030 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 393/767] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:16:35 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:16:36.132308 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-09d09173-74ed-40eb-83b3-e84595ef2979 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:36.133157 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-09d09173-74ed-40eb-83b3-e84595ef2979 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:36.139228 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-09d09173-74ed-40eb-83b3-e84595ef2979 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:36.139681 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-09d09173-74ed-40eb-83b3-e84595ef2979 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:36.142621 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-09d09173-74ed-40eb-83b3-e84595ef2979 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:36.142621 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-09d09173-74ed-40eb-83b3-e84595ef2979 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:36.166895 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d8d4b37e-6f4f-4152-8789-3af1fe72c9b7 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:36.167572 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d8d4b37e-6f4f-4152-8789-3af1fe72c9b7 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] [instance: 982d841e-c5c6-44a9-9982-44f8cc31b618] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:36.179754 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d8d4b37e-6f4f-4152-8789-3af1fe72c9b7 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:36.180216 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d8d4b37e-6f4f-4152-8789-3af1fe72c9b7 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:36.181031 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d8d4b37e-6f4f-4152-8789-3af1fe72c9b7 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:36.181553 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d8d4b37e-6f4f-4152-8789-3af1fe72c9b7 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:36.196068 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.wsgi [None req-d8d4b37e-6f4f-4152-8789-3af1fe72c9b7 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] HTTP exception thrown: Instance 982d841e-c5c6-44a9-9982-44f8cc31b618 could not be found. Feb 09 13:16:36.196676 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d8d4b37e-6f4f-4152-8789-3af1fe72c9b7 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Returning 404 to user: Instance 982d841e-c5c6-44a9-9982-44f8cc31b618 could not be found. {{(pid=116748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:16:36.197853 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d8d4b37e-6f4f-4152-8789-3af1fe72c9b7 tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618" status: 404 len: 111 microversion: 2.1 time: 0.034382 Feb 09 13:16:36.203884 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 394/768] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:36 2022] GET /compute/v2.1/servers/982d841e-c5c6-44a9-9982-44f8cc31b618 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 09 13:16:36.205806 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-09d09173-74ed-40eb-83b3-e84595ef2979 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:36.211652 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-93479e03-3a0e-43f1-b2ce-f05e28f7245e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] Calling method '.version_select at 0x7f7f6454bf70>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:36.223675 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-09d09173-74ed-40eb-83b3-e84595ef2979 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2" status: 200 len: 1242 microversion: 2.1 time: 0.096321 Feb 09 13:16:36.224424 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 375/769] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:36 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2 => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:16:36.319675 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-93479e03-3a0e-43f1-b2ce-f05e28f7245e tempest-TestMinimumBasicScenario-1152660463 tempest-TestMinimumBasicScenario-1152660463-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-904893309" status: 202 len: 0 microversion: 2.1 time: 0.114372 Feb 09 13:16:36.320526 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 395/770] 10.222.0.84 () {58 vars in 1268 bytes} [Wed Feb 9 13:16:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-904893309 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:16:36.825950 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-3964627d-f5ec-495c-83d8-55d954d8098f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:36.826584 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-3964627d-f5ec-495c-83d8-55d954d8098f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:36.834109 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3964627d-f5ec-495c-83d8-55d954d8098f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:36.834884 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3964627d-f5ec-495c-83d8-55d954d8098f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:36.835784 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3964627d-f5ec-495c-83d8-55d954d8098f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:36.836327 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3964627d-f5ec-495c-83d8-55d954d8098f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:36.978464 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3964627d-f5ec-495c-83d8-55d954d8098f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:36.986421 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3964627d-f5ec-495c-83d8-55d954d8098f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:36.987941 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3964627d-f5ec-495c-83d8-55d954d8098f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:36.989067 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-3964627d-f5ec-495c-83d8-55d954d8098f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1405 microversion: 2.20 time: 0.167051 Feb 09 13:16:36.989621 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 376/771] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:16:36 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:16:37.241136 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d61371ba-338f-4d88-97fb-2d48277f085d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:37.241752 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d61371ba-338f-4d88-97fb-2d48277f085d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:37.248312 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d61371ba-338f-4d88-97fb-2d48277f085d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:37.248769 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d61371ba-338f-4d88-97fb-2d48277f085d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:37.249555 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d61371ba-338f-4d88-97fb-2d48277f085d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:37.249994 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d61371ba-338f-4d88-97fb-2d48277f085d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:37.321566 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d61371ba-338f-4d88-97fb-2d48277f085d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:37.329535 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d61371ba-338f-4d88-97fb-2d48277f085d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2" status: 200 len: 1298 microversion: 2.1 time: 0.092771 Feb 09 13:16:37.332635 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 396/772] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:37 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2 => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:16:38.007472 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-7206f937-f71b-4b87-84d3-67306c13e905 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:38.008786 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-7206f937-f71b-4b87-84d3-67306c13e905 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:38.017494 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7206f937-f71b-4b87-84d3-67306c13e905 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:38.018309 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7206f937-f71b-4b87-84d3-67306c13e905 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:38.019338 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7206f937-f71b-4b87-84d3-67306c13e905 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:38.020521 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7206f937-f71b-4b87-84d3-67306c13e905 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:38.265057 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-7206f937-f71b-4b87-84d3-67306c13e905 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:38.273213 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-7206f937-f71b-4b87-84d3-67306c13e905 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:38.275090 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-7206f937-f71b-4b87-84d3-67306c13e905 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:38.276479 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-7206f937-f71b-4b87-84d3-67306c13e905 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1405 microversion: 2.20 time: 0.272968 Feb 09 13:16:38.277223 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 377/773] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:16:38 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1405 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:16:38.346618 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-3f62b314-51dc-4edf-9758-0ce5e99107ff tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:38.348005 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-3f62b314-51dc-4edf-9758-0ce5e99107ff tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:38.354745 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3f62b314-51dc-4edf-9758-0ce5e99107ff tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:38.355551 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3f62b314-51dc-4edf-9758-0ce5e99107ff tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:38.356564 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3f62b314-51dc-4edf-9758-0ce5e99107ff tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:38.357225 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3f62b314-51dc-4edf-9758-0ce5e99107ff tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:38.452054 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-d261daa1-8bc4-49fa-ac2e-e08e5a4b8bf2 req-5d2e14a2-27eb-472c-ae15-de37fae36c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece0c49e-784a-49c1-85c1-de2a95a93e00", "name": "network-vif-plugged", "status": "completed", "tag": "8fc972e9-0cc0-429d-a82a-fd959fe8f9d3"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:16:38.454149 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:16:38.454149 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:16:38.462523 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-d261daa1-8bc4-49fa-ac2e-e08e5a4b8bf2 req-5d2e14a2-27eb-472c-ae15-de37fae36c38 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:38.463122 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-d261daa1-8bc4-49fa-ac2e-e08e5a4b8bf2 req-5d2e14a2-27eb-472c-ae15-de37fae36c38 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:38.476924 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-d261daa1-8bc4-49fa-ac2e-e08e5a4b8bf2 req-5d2e14a2-27eb-472c-ae15-de37fae36c38 service nova] Creating event network-vif-plugged:8fc972e9-0cc0-429d-a82a-fd959fe8f9d3 for instance ece0c49e-784a-49c1-85c1-de2a95a93e00 on hv-cinder-82786 Feb 09 13:16:38.482400 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-d261daa1-8bc4-49fa-ac2e-e08e5a4b8bf2 req-5d2e14a2-27eb-472c-ae15-de37fae36c38 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033726 Feb 09 13:16:38.483156 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 378/774] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:16:38.590520 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-3f62b314-51dc-4edf-9758-0ce5e99107ff tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:38.600943 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-3f62b314-51dc-4edf-9758-0ce5e99107ff tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2" status: 200 len: 1364 microversion: 2.1 time: 0.258044 Feb 09 13:16:38.602481 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 397/775] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:38 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2 => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:16:39.291184 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-32533305-9520-4a5a-8f43-eb1fea9bea8c req-d34a6d50-e9a6-47f2-81f1-84cef1eefcb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84445fb8-4a25-468e-a8ad-e060b55105a2", "tag": "fb9e09f7-4b57-4b24-ae7e-ae897c352559"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:16:39.292718 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:16:39.292718 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:16:39.296295 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-f47db591-8766-43b9-96e3-1e3b11652dff tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:39.297124 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-f47db591-8766-43b9-96e3-1e3b11652dff tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:39.306881 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f47db591-8766-43b9-96e3-1e3b11652dff tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:39.307654 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f47db591-8766-43b9-96e3-1e3b11652dff tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:39.309424 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f47db591-8766-43b9-96e3-1e3b11652dff tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:39.309556 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-32533305-9520-4a5a-8f43-eb1fea9bea8c req-d34a6d50-e9a6-47f2-81f1-84cef1eefcb4 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:39.310778 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f47db591-8766-43b9-96e3-1e3b11652dff tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:39.311411 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-32533305-9520-4a5a-8f43-eb1fea9bea8c req-d34a6d50-e9a6-47f2-81f1-84cef1eefcb4 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:39.339228 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-32533305-9520-4a5a-8f43-eb1fea9bea8c req-d34a6d50-e9a6-47f2-81f1-84cef1eefcb4 service nova] Creating event network-changed:fb9e09f7-4b57-4b24-ae7e-ae897c352559 for instance 84445fb8-4a25-468e-a8ad-e060b55105a2 on hv-cinder-82786 Feb 09 13:16:39.348455 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-32533305-9520-4a5a-8f43-eb1fea9bea8c req-d34a6d50-e9a6-47f2-81f1-84cef1eefcb4 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064646 Feb 09 13:16:39.349855 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 379/776] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:16:39.513081 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f47db591-8766-43b9-96e3-1e3b11652dff tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:39.522458 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f47db591-8766-43b9-96e3-1e3b11652dff tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:39.524267 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f47db591-8766-43b9-96e3-1e3b11652dff tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:39.525459 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-f47db591-8766-43b9-96e3-1e3b11652dff tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1405 microversion: 2.20 time: 0.234579 Feb 09 13:16:39.526652 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 398/777] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:16:39 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:16:39.619184 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-36241e12-7805-4363-bb7d-88aaaa59b904 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:39.619720 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-36241e12-7805-4363-bb7d-88aaaa59b904 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:39.627453 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-36241e12-7805-4363-bb7d-88aaaa59b904 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:39.627904 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-36241e12-7805-4363-bb7d-88aaaa59b904 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:39.628703 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-36241e12-7805-4363-bb7d-88aaaa59b904 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:39.629140 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-36241e12-7805-4363-bb7d-88aaaa59b904 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:39.828204 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-36241e12-7805-4363-bb7d-88aaaa59b904 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:39.835418 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-36241e12-7805-4363-bb7d-88aaaa59b904 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2" status: 200 len: 1364 microversion: 2.1 time: 0.220778 Feb 09 13:16:39.836490 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 380/778] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:39 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2 => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:16:40.543150 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-e0cbea3c-ee36-4e65-b06b-ba7de8d9855d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:40.543763 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-e0cbea3c-ee36-4e65-b06b-ba7de8d9855d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:40.549995 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e0cbea3c-ee36-4e65-b06b-ba7de8d9855d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:40.550451 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e0cbea3c-ee36-4e65-b06b-ba7de8d9855d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:40.551281 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e0cbea3c-ee36-4e65-b06b-ba7de8d9855d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:40.551754 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e0cbea3c-ee36-4e65-b06b-ba7de8d9855d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:40.854321 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-febe72dd-2ed8-4192-8661-df17f9ce5626 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:40.855580 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-febe72dd-2ed8-4192-8661-df17f9ce5626 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:40.862926 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-febe72dd-2ed8-4192-8661-df17f9ce5626 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:40.863363 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-febe72dd-2ed8-4192-8661-df17f9ce5626 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:40.864369 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-febe72dd-2ed8-4192-8661-df17f9ce5626 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:40.864809 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-febe72dd-2ed8-4192-8661-df17f9ce5626 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:40.914942 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e0cbea3c-ee36-4e65-b06b-ba7de8d9855d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:40.923228 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e0cbea3c-ee36-4e65-b06b-ba7de8d9855d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:40.924831 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e0cbea3c-ee36-4e65-b06b-ba7de8d9855d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:40.926128 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-e0cbea3c-ee36-4e65-b06b-ba7de8d9855d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1596 microversion: 2.20 time: 0.386743 Feb 09 13:16:40.927141 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 399/779] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:16:40 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1596 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:16:40.943876 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-8a116b45-7e25-4637-b3f8-44239be26f3b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:40.944420 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-8a116b45-7e25-4637-b3f8-44239be26f3b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:40.950120 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8a116b45-7e25-4637-b3f8-44239be26f3b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:40.950733 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8a116b45-7e25-4637-b3f8-44239be26f3b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:40.951524 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8a116b45-7e25-4637-b3f8-44239be26f3b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:40.951961 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8a116b45-7e25-4637-b3f8-44239be26f3b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:41.002705 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-febe72dd-2ed8-4192-8661-df17f9ce5626 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:41.011387 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-febe72dd-2ed8-4192-8661-df17f9ce5626 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2" status: 200 len: 1364 microversion: 2.1 time: 0.162806 Feb 09 13:16:41.021234 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 381/780] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:40 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:16:41.041553 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-8a116b45-7e25-4637-b3f8-44239be26f3b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101822 Feb 09 13:16:41.042268 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 400/781] 10.222.0.84 () {60 vars in 1315 bytes} [Wed Feb 9 13:16:40 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 09 13:16:42.029206 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-0938d678-7942-46b8-9874-7ebfee337c9b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:42.029735 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-0938d678-7942-46b8-9874-7ebfee337c9b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:42.036765 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0938d678-7942-46b8-9874-7ebfee337c9b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:42.037218 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0938d678-7942-46b8-9874-7ebfee337c9b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:42.041016 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0938d678-7942-46b8-9874-7ebfee337c9b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:42.041016 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0938d678-7942-46b8-9874-7ebfee337c9b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:42.198360 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-0938d678-7942-46b8-9874-7ebfee337c9b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:42.207778 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-0938d678-7942-46b8-9874-7ebfee337c9b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2" status: 200 len: 1364 microversion: 2.1 time: 0.182410 Feb 09 13:16:42.216417 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-0d0f9a8b-2416-4d01-8d3c-7d779936edab tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:42.218300 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-0d0f9a8b-2416-4d01-8d3c-7d779936edab tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:42.225252 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 382/782] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:42 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2 => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:16:42.229103 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0d0f9a8b-2416-4d01-8d3c-7d779936edab tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:42.229640 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0d0f9a8b-2416-4d01-8d3c-7d779936edab tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:42.231302 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0d0f9a8b-2416-4d01-8d3c-7d779936edab tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:42.231956 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0d0f9a8b-2416-4d01-8d3c-7d779936edab tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:42.331616 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-ee772f39-a19b-48c4-b7e2-52c7c16454bb req-bdc058e6-e4d7-4a1d-a0af-1707eede7c36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ece0c49e-784a-49c1-85c1-de2a95a93e00", "tag": "8fc972e9-0cc0-429d-a82a-fd959fe8f9d3"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:16:42.333763 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:16:42.333763 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:16:42.341879 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-ee772f39-a19b-48c4-b7e2-52c7c16454bb req-bdc058e6-e4d7-4a1d-a0af-1707eede7c36 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:42.343250 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-ee772f39-a19b-48c4-b7e2-52c7c16454bb req-bdc058e6-e4d7-4a1d-a0af-1707eede7c36 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:42.362083 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-ee772f39-a19b-48c4-b7e2-52c7c16454bb req-bdc058e6-e4d7-4a1d-a0af-1707eede7c36 service nova] Creating event network-changed:8fc972e9-0cc0-429d-a82a-fd959fe8f9d3 for instance ece0c49e-784a-49c1-85c1-de2a95a93e00 on hv-cinder-82786 Feb 09 13:16:42.368712 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-ee772f39-a19b-48c4-b7e2-52c7c16454bb req-bdc058e6-e4d7-4a1d-a0af-1707eede7c36 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141898 Feb 09 13:16:42.369887 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 383/783] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:16:42.509883 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-0d0f9a8b-2416-4d01-8d3c-7d779936edab tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:42.524534 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-0d0f9a8b-2416-4d01-8d3c-7d779936edab tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:42.528080 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-0d0f9a8b-2416-4d01-8d3c-7d779936edab tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:42.530151 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-0d0f9a8b-2416-4d01-8d3c-7d779936edab tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1596 microversion: 2.20 time: 0.320278 Feb 09 13:16:42.542256 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 401/784] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:16:42 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1596 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:16:43.239991 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-931f22c9-8611-4257-8198-148d6a4de25c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:43.241291 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-931f22c9-8611-4257-8198-148d6a4de25c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:43.249016 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-931f22c9-8611-4257-8198-148d6a4de25c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:43.249689 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-931f22c9-8611-4257-8198-148d6a4de25c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:43.250587 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-931f22c9-8611-4257-8198-148d6a4de25c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:43.251120 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-931f22c9-8611-4257-8198-148d6a4de25c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:43.411086 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-931f22c9-8611-4257-8198-148d6a4de25c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:43.418763 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-931f22c9-8611-4257-8198-148d6a4de25c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2" status: 200 len: 1364 microversion: 2.1 time: 0.182861 Feb 09 13:16:43.419760 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 384/785] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:43 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:16:43.548323 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d897d67c-902a-445a-a80e-98d24a57872f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:43.549234 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d897d67c-902a-445a-a80e-98d24a57872f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:43.556602 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d897d67c-902a-445a-a80e-98d24a57872f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:43.557134 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d897d67c-902a-445a-a80e-98d24a57872f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:43.558164 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d897d67c-902a-445a-a80e-98d24a57872f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:43.558711 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d897d67c-902a-445a-a80e-98d24a57872f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:43.814858 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d897d67c-902a-445a-a80e-98d24a57872f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:43.823220 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d897d67c-902a-445a-a80e-98d24a57872f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:43.824815 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d897d67c-902a-445a-a80e-98d24a57872f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:43.826020 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d897d67c-902a-445a-a80e-98d24a57872f tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1714 microversion: 2.20 time: 0.281444 Feb 09 13:16:43.826600 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 402/786] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:16:43 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1714 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:16:43.844662 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-2ee18732-0841-4d24-858d-3c1dbe8c9972 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:43.845095 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-2ee18732-0841-4d24-858d-3c1dbe8c9972 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:43.851807 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2ee18732-0841-4d24-858d-3c1dbe8c9972 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:43.852268 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2ee18732-0841-4d24-858d-3c1dbe8c9972 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:43.853130 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2ee18732-0841-4d24-858d-3c1dbe8c9972 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:43.853618 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2ee18732-0841-4d24-858d-3c1dbe8c9972 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:43.877578 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-2ee18732-0841-4d24-858d-3c1dbe8c9972 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00/ips" status: 200 len: 150 microversion: 2.20 time: 0.036792 Feb 09 13:16:43.878089 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 385/787] 10.222.0.84 () {60 vars in 1288 bytes} [Wed Feb 9 13:16:43 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 09 13:16:44.438029 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-3a949786-afaf-4a42-9fec-3b1cc8ade5d6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:44.439019 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-3a949786-afaf-4a42-9fec-3b1cc8ade5d6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:44.445704 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3a949786-afaf-4a42-9fec-3b1cc8ade5d6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:44.446831 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3a949786-afaf-4a42-9fec-3b1cc8ade5d6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:44.448244 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3a949786-afaf-4a42-9fec-3b1cc8ade5d6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:44.449020 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3a949786-afaf-4a42-9fec-3b1cc8ade5d6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:44.478112 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-0039e64c-abcd-4fb4-99e9-c2a81474ccf7 req-a7eec0a4-fe49-407a-90e9-17ee9c180a33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84445fb8-4a25-468e-a8ad-e060b55105a2", "name": "network-vif-plugged", "status": "completed", "tag": "fb9e09f7-4b57-4b24-ae7e-ae897c352559"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:16:44.480723 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:16:44.480723 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:16:44.491315 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-0039e64c-abcd-4fb4-99e9-c2a81474ccf7 req-a7eec0a4-fe49-407a-90e9-17ee9c180a33 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:44.492355 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-0039e64c-abcd-4fb4-99e9-c2a81474ccf7 req-a7eec0a4-fe49-407a-90e9-17ee9c180a33 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:44.504837 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-0039e64c-abcd-4fb4-99e9-c2a81474ccf7 req-a7eec0a4-fe49-407a-90e9-17ee9c180a33 service nova] Creating event network-vif-plugged:fb9e09f7-4b57-4b24-ae7e-ae897c352559 for instance 84445fb8-4a25-468e-a8ad-e060b55105a2 on hv-cinder-82786 Feb 09 13:16:44.509827 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-0039e64c-abcd-4fb4-99e9-c2a81474ccf7 req-a7eec0a4-fe49-407a-90e9-17ee9c180a33 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037657 Feb 09 13:16:44.523876 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 386/788] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:16:44.710820 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-3a949786-afaf-4a42-9fec-3b1cc8ade5d6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:44.719155 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-3a949786-afaf-4a42-9fec-3b1cc8ade5d6 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2" status: 200 len: 1364 microversion: 2.1 time: 0.286256 Feb 09 13:16:44.729774 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 403/789] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:44 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2 => generated 1364 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:16:45.737444 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d34705bb-b318-4402-945d-81a4a9ebde3d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:45.738965 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d34705bb-b318-4402-945d-81a4a9ebde3d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:45.745899 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d34705bb-b318-4402-945d-81a4a9ebde3d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:45.746678 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d34705bb-b318-4402-945d-81a4a9ebde3d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:45.747706 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d34705bb-b318-4402-945d-81a4a9ebde3d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:45.748149 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d34705bb-b318-4402-945d-81a4a9ebde3d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:45.905918 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-d34705bb-b318-4402-945d-81a4a9ebde3d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:45.913704 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d34705bb-b318-4402-945d-81a4a9ebde3d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2" status: 200 len: 1364 microversion: 2.1 time: 0.180993 Feb 09 13:16:45.914387 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 387/790] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:45 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2 => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:16:46.933565 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-51bfb688-4ebf-4deb-8fcf-9bfb6fcffb0b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:46.934180 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-51bfb688-4ebf-4deb-8fcf-9bfb6fcffb0b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:46.940907 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-51bfb688-4ebf-4deb-8fcf-9bfb6fcffb0b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:46.942066 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-51bfb688-4ebf-4deb-8fcf-9bfb6fcffb0b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:46.942245 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-51bfb688-4ebf-4deb-8fcf-9bfb6fcffb0b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:46.942746 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-51bfb688-4ebf-4deb-8fcf-9bfb6fcffb0b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:47.090246 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-51bfb688-4ebf-4deb-8fcf-9bfb6fcffb0b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:47.098879 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-51bfb688-4ebf-4deb-8fcf-9bfb6fcffb0b tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2" status: 200 len: 1550 microversion: 2.1 time: 0.168299 Feb 09 13:16:47.099690 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 404/791] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:46 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2 => generated 1550 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:16:47.114678 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-2602a216-1abb-4869-b3c8-a133052af1dd tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:47.115198 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-2602a216-1abb-4869-b3c8-a133052af1dd tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:47.121311 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2602a216-1abb-4869-b3c8-a133052af1dd tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:47.121766 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2602a216-1abb-4869-b3c8-a133052af1dd tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:47.122576 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2602a216-1abb-4869-b3c8-a133052af1dd tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:47.123019 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2602a216-1abb-4869-b3c8-a133052af1dd tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:47.208942 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-2602a216-1abb-4869-b3c8-a133052af1dd tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097848 Feb 09 13:16:47.209613 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 388/792] 10.222.0.84 () {58 vars in 1274 bytes} [Wed Feb 9 13:16:47 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:16:48.384917 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-6b2a7062-b0d9-48b0-9440-b5f6d3c9e99f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:48.385872 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-6b2a7062-b0d9-48b0-9440-b5f6d3c9e99f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:48.387992 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-14d36b6a-7078-410d-b3d3-922e4a254b07 req-919028a9-0040-413b-b71f-2e45f7e28e3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84445fb8-4a25-468e-a8ad-e060b55105a2", "tag": "fb9e09f7-4b57-4b24-ae7e-ae897c352559"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:16:48.390127 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:16:48.390127 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:16:48.393968 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6b2a7062-b0d9-48b0-9440-b5f6d3c9e99f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:48.394206 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6b2a7062-b0d9-48b0-9440-b5f6d3c9e99f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:48.395287 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6b2a7062-b0d9-48b0-9440-b5f6d3c9e99f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:48.396121 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6b2a7062-b0d9-48b0-9440-b5f6d3c9e99f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:48.398295 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-14d36b6a-7078-410d-b3d3-922e4a254b07 req-919028a9-0040-413b-b71f-2e45f7e28e3f service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:48.398769 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-14d36b6a-7078-410d-b3d3-922e4a254b07 req-919028a9-0040-413b-b71f-2e45f7e28e3f service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:48.413897 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-14d36b6a-7078-410d-b3d3-922e4a254b07 req-919028a9-0040-413b-b71f-2e45f7e28e3f service nova] Creating event network-changed:fb9e09f7-4b57-4b24-ae7e-ae897c352559 for instance 84445fb8-4a25-468e-a8ad-e060b55105a2 on hv-cinder-82786 Feb 09 13:16:48.419484 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-14d36b6a-7078-410d-b3d3-922e4a254b07 req-919028a9-0040-413b-b71f-2e45f7e28e3f service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035067 Feb 09 13:16:48.420855 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 389/793] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:16:48.567283 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6b2a7062-b0d9-48b0-9440-b5f6d3c9e99f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:48.574350 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-6b2a7062-b0d9-48b0-9440-b5f6d3c9e99f tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2" status: 200 len: 1550 microversion: 2.1 time: 0.193313 Feb 09 13:16:48.574986 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 405/794] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:48 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2 => generated 1550 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:16:49.593808 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-358b0f3a-97e9-4ec9-84fb-d276b92245e9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:49.594431 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-358b0f3a-97e9-4ec9-84fb-d276b92245e9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:49.600873 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-358b0f3a-97e9-4ec9-84fb-d276b92245e9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:49.601337 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-358b0f3a-97e9-4ec9-84fb-d276b92245e9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:49.602130 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-358b0f3a-97e9-4ec9-84fb-d276b92245e9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:49.602785 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-358b0f3a-97e9-4ec9-84fb-d276b92245e9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:49.745868 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-358b0f3a-97e9-4ec9-84fb-d276b92245e9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:16:49.753540 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-358b0f3a-97e9-4ec9-84fb-d276b92245e9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2" status: 200 len: 1669 microversion: 2.1 time: 0.164119 Feb 09 13:16:49.754140 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 390/795] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:16:49 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2 => generated 1669 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:16:49.770538 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-af9cffe4-a873-4a0a-9a53-bf4a461f1648 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:16:49.777816 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-af9cffe4-a873-4a0a-9a53-bf4a461f1648 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:49.778315 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-af9cffe4-a873-4a0a-9a53-bf4a461f1648 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:49.778810 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-af9cffe4-a873-4a0a-9a53-bf4a461f1648 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:49.779617 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-af9cffe4-a873-4a0a-9a53-bf4a461f1648 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:49.780064 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-af9cffe4-a873-4a0a-9a53-bf4a461f1648 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:49.808079 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-af9cffe4-a873-4a0a-9a53-bf4a461f1648 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/ips" status: 200 len: 146 microversion: 2.1 time: 0.041473 Feb 09 13:16:49.808644 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 406/796] 10.222.0.84 () {58 vars in 1247 bytes} [Wed Feb 9 13:16:49 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:16:51.720114 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-5b9fe8a6-99d0-48f5-961b-3c8b90f295a2 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6582ef49-c114-4a9a-8bc5-6b7ddcfde5ff"}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:16:51.722255 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-5b9fe8a6-99d0-48f5-961b-3c8b90f295a2 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:16:51.730422 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5b9fe8a6-99d0-48f5-961b-3c8b90f295a2 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:51.730945 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5b9fe8a6-99d0-48f5-961b-3c8b90f295a2 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:51.732140 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5b9fe8a6-99d0-48f5-961b-3c8b90f295a2 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:16:51.732779 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5b9fe8a6-99d0-48f5-961b-3c8b90f295a2 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:16:52.675696 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-5b9fe8a6-99d0-48f5-961b-3c8b90f295a2 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "POST /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.959127 Feb 09 13:16:52.677120 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 391/797] 10.222.0.84 () {60 vars in 1322 bytes} [Wed Feb 9 13:16:51 2022] POST /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-volume_attachments => generated 194 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:17:00.232118 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-5a2ac1bd-5922-4e6a-bfd2-8cf4849c7520 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:00.233106 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-5a2ac1bd-5922-4e6a-bfd2-8cf4849c7520 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:00.240511 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5a2ac1bd-5922-4e6a-bfd2-8cf4849c7520 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:00.240967 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5a2ac1bd-5922-4e6a-bfd2-8cf4849c7520 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:00.241767 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5a2ac1bd-5922-4e6a-bfd2-8cf4849c7520 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:00.242211 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5a2ac1bd-5922-4e6a-bfd2-8cf4849c7520 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:00.278096 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-5a2ac1bd-5922-4e6a-bfd2-8cf4849c7520 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049904 Feb 09 13:17:00.289989 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8637e3e8-8a14-4f7c-9fe5-488a25264d5c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:00.290599 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8637e3e8-8a14-4f7c-9fe5-488a25264d5c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:00.293766 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 407/798] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:17:00 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:17:00.297137 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8637e3e8-8a14-4f7c-9fe5-488a25264d5c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:00.297604 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8637e3e8-8a14-4f7c-9fe5-488a25264d5c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:00.298401 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8637e3e8-8a14-4f7c-9fe5-488a25264d5c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:00.298863 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8637e3e8-8a14-4f7c-9fe5-488a25264d5c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:00.329103 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8637e3e8-8a14-4f7c-9fe5-488a25264d5c tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-volume_attachments/6582ef49-c114-4a9a-8bc5-6b7ddcfde5ff" status: 200 len: 194 microversion: 2.1 time: 0.044180 Feb 09 13:17:00.330255 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 392/799] 10.222.0.84 () {58 vars in 1412 bytes} [Wed Feb 9 13:17:00 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-volume_attachments/6582ef49-c114-4a9a-8bc5-6b7ddcfde5ff => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:17:02.095865 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-bed7017c-723b-47f4-ac4f-66c739d275e9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d92d6aed-560d-492c-95b4-24ffcf14bda2"}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:17:02.097373 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-bed7017c-723b-47f4-ac4f-66c739d275e9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:02.104720 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bed7017c-723b-47f4-ac4f-66c739d275e9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:02.105182 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bed7017c-723b-47f4-ac4f-66c739d275e9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:02.105988 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bed7017c-723b-47f4-ac4f-66c739d275e9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:02.106667 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bed7017c-723b-47f4-ac4f-66c739d275e9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:02.177359 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-f2067c49-e20b-47d6-8bb1-7a1a4414cc38 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Action: 'create', calling method: .version_select at 0x7f7f645aa280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-423323945"}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:17:02.191885 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-f2067c49-e20b-47d6-8bb1-7a1a4414cc38 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Getting quotas for project d5ef8e70a161475ab7130108627df2e4. Resources: {'key_pairs'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:17:02.196034 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-f2067c49-e20b-47d6-8bb1-7a1a4414cc38 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Getting quotas for user 11b331092b7645388e37636426326374 and project d5ef8e70a161475ab7130108627df2e4. Resources: {'key_pairs'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:17:02.609602 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-f2067c49-e20b-47d6-8bb1-7a1a4414cc38 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Getting quotas for project d5ef8e70a161475ab7130108627df2e4. Resources: {'key_pairs'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:17:02.613460 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-f2067c49-e20b-47d6-8bb1-7a1a4414cc38 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Getting quotas for user 11b331092b7645388e37636426326374 and project d5ef8e70a161475ab7130108627df2e4. Resources: {'key_pairs'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:17:02.626387 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-f2067c49-e20b-47d6-8bb1-7a1a4414cc38 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.631404 Feb 09 13:17:02.627217 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 408/800] 10.222.0.84 () {60 vars in 1157 bytes} [Wed Feb 9 13:17:01 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:17:02.985785 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-bed7017c-723b-47f4-ac4f-66c739d275e9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "POST /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.893515 Feb 09 13:17:02.991111 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 393/801] 10.222.0.84 () {60 vars in 1322 bytes} [Wed Feb 9 13:17:02 2022] POST /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-volume_attachments => generated 194 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:17:10.655619 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-639f5252-402d-46b1-a07d-b35a31bac375 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:10.656647 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-639f5252-402d-46b1-a07d-b35a31bac375 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:10.663704 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-639f5252-402d-46b1-a07d-b35a31bac375 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:10.664944 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-639f5252-402d-46b1-a07d-b35a31bac375 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:10.665806 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-639f5252-402d-46b1-a07d-b35a31bac375 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:10.666300 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-639f5252-402d-46b1-a07d-b35a31bac375 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:10.697979 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-639f5252-402d-46b1-a07d-b35a31bac375 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046883 Feb 09 13:17:10.698534 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 409/802] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:17:10 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:17:23.013589 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d3e96f4a-61d8-4406-89b6-8d532ae9263a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1622450951", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-423323945", "security_groups": [{"name": "tempest-secgroup-smoke-147747940"}], "block_device_mapping_v2": [{"uuid": "76b08560-4cba-4e7a-a167-876eca2790f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05ef35c6-6e26-4081-883e-e7a7d012ab72"}]}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:17:23.128446 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.network.neutron [None req-d3e96f4a-61d8-4406-89b6-8d532ae9263a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] validate_networks() for [('05ef35c6-6e26-4081-883e-e7a7d012ab72', None, None, None, None, None)] {{(pid=116749) validate_networks /opt/stack/nova/nova/network/neutron.py:2554}} Feb 09 13:17:23.255020 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-0aabcc2e-540a-4be9-8ed1-7ed2c976faf2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:17:23.255564 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-0aabcc2e-540a-4be9-8ed1-7ed2c976faf2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:23.262547 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0aabcc2e-540a-4be9-8ed1-7ed2c976faf2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:23.263039 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0aabcc2e-540a-4be9-8ed1-7ed2c976faf2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:23.263852 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0aabcc2e-540a-4be9-8ed1-7ed2c976faf2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:23.264803 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0aabcc2e-540a-4be9-8ed1-7ed2c976faf2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:23.289875 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-0aabcc2e-540a-4be9-8ed1-7ed2c976faf2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lazy-loading 'flavor' on Instance uuid ece0c49e-784a-49c1-85c1-de2a95a93e00 {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:17:23.531656 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-d3e96f4a-61d8-4406-89b6-8d532ae9263a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Flavor limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 09 13:17:23.532086 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-d3e96f4a-61d8-4406-89b6-8d532ae9263a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Image limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 09 13:17:23.532602 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-d3e96f4a-61d8-4406-89b6-8d532ae9263a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Flavor pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 09 13:17:23.533025 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-d3e96f4a-61d8-4406-89b6-8d532ae9263a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Image pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 09 13:17:23.533436 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-d3e96f4a-61d8-4406-89b6-8d532ae9263a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 09 13:17:23.543354 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d3e96f4a-61d8-4406-89b6-8d532ae9263a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:23.549447 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d3e96f4a-61d8-4406-89b6-8d532ae9263a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:23.549447 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d3e96f4a-61d8-4406-89b6-8d532ae9263a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:23.549447 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d3e96f4a-61d8-4406-89b6-8d532ae9263a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:23.563648 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-d3e96f4a-61d8-4406-89b6-8d532ae9263a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Getting quotas for project d5ef8e70a161475ab7130108627df2e4. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:17:23.568533 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-d3e96f4a-61d8-4406-89b6-8d532ae9263a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Getting quotas for user 11b331092b7645388e37636426326374 and project d5ef8e70a161475ab7130108627df2e4. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:17:23.640039 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d3e96f4a-61d8-4406-89b6-8d532ae9263a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Going to run 1 instances... {{(pid=116749) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 09 13:17:23.643450 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d3e96f4a-61d8-4406-89b6-8d532ae9263a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='76b08560-4cba-4e7a-a167-876eca2790f6',volume_size=None,volume_type=None)] {{(pid=116749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 09 13:17:23.855502 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-0aabcc2e-540a-4be9-8ed1-7ed2c976faf2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "POST /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00/action" status: 202 len: 0 microversion: 2.20 time: 0.604043 Feb 09 13:17:23.856129 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 410/803] 10.222.0.84 () {62 vars in 1318 bytes} [Wed Feb 9 13:17:23 2022] POST /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 09 13:17:23.864368 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-bcfed46c-2dcd-400a-b742-34443c2a7c7b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:23.865037 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-bcfed46c-2dcd-400a-b742-34443c2a7c7b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:23.872533 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bcfed46c-2dcd-400a-b742-34443c2a7c7b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:23.877336 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bcfed46c-2dcd-400a-b742-34443c2a7c7b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:23.877336 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bcfed46c-2dcd-400a-b742-34443c2a7c7b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:23.877336 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bcfed46c-2dcd-400a-b742-34443c2a7c7b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:24.013545 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-bcfed46c-2dcd-400a-b742-34443c2a7c7b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:24.021430 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-bcfed46c-2dcd-400a-b742-34443c2a7c7b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:24.022977 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-bcfed46c-2dcd-400a-b742-34443c2a7c7b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:24.032368 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-bcfed46c-2dcd-400a-b742-34443c2a7c7b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1720 microversion: 2.20 time: 0.163714 Feb 09 13:17:24.032368 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 411/804] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:23 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:17:24.131142 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d3e96f4a-61d8-4406-89b6-8d532ae9263a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.122395 Feb 09 13:17:24.136612 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 394/805] 10.222.0.84 () {60 vars in 1146 bytes} [Wed Feb 9 13:17:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 09 13:17:24.141559 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-a6e51bad-8c2b-43c9-a11e-83bd6c681130 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:24.142194 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-a6e51bad-8c2b-43c9-a11e-83bd6c681130 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:24.195691 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a6e51bad-8c2b-43c9-a11e-83bd6c681130 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:24.202275 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-a6e51bad-8c2b-43c9-a11e-83bd6c681130 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1094 microversion: 2.1 time: 0.064413 Feb 09 13:17:24.202903 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 412/806] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:24 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:17:25.043256 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-3b0f838d-d384-42ef-a845-5c73f8dc50d3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:25.045080 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-3b0f838d-d384-42ef-a845-5c73f8dc50d3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:25.052404 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3b0f838d-d384-42ef-a845-5c73f8dc50d3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:25.052850 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3b0f838d-d384-42ef-a845-5c73f8dc50d3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:25.053628 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3b0f838d-d384-42ef-a845-5c73f8dc50d3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:25.054059 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3b0f838d-d384-42ef-a845-5c73f8dc50d3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:25.193304 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3b0f838d-d384-42ef-a845-5c73f8dc50d3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:25.201233 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3b0f838d-d384-42ef-a845-5c73f8dc50d3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:25.202969 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3b0f838d-d384-42ef-a845-5c73f8dc50d3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:25.203958 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-3b0f838d-d384-42ef-a845-5c73f8dc50d3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1720 microversion: 2.20 time: 0.164450 Feb 09 13:17:25.204533 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 395/807] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:25 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:17:25.219527 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-fe71610f-a589-4413-834d-e5c73b6f81df tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:25.220146 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-fe71610f-a589-4413-834d-e5c73b6f81df tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:25.277211 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-fe71610f-a589-4413-834d-e5c73b6f81df tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:25.284763 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-fe71610f-a589-4413-834d-e5c73b6f81df tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1094 microversion: 2.1 time: 0.068929 Feb 09 13:17:25.285433 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 413/808] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:25 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:17:26.221949 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-6e277a31-cde1-4ea5-9299-b020f7b96cbb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:26.222579 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-6e277a31-cde1-4ea5-9299-b020f7b96cbb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:26.229184 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6e277a31-cde1-4ea5-9299-b020f7b96cbb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:26.229635 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6e277a31-cde1-4ea5-9299-b020f7b96cbb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:26.230458 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6e277a31-cde1-4ea5-9299-b020f7b96cbb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:26.230921 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6e277a31-cde1-4ea5-9299-b020f7b96cbb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:26.301287 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-21aeb6de-14ab-4da2-bda2-c9d897d116df tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:26.302092 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-21aeb6de-14ab-4da2-bda2-c9d897d116df tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:26.308471 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-21aeb6de-14ab-4da2-bda2-c9d897d116df tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:26.308918 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-21aeb6de-14ab-4da2-bda2-c9d897d116df tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:26.309700 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-21aeb6de-14ab-4da2-bda2-c9d897d116df tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:26.310134 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-21aeb6de-14ab-4da2-bda2-c9d897d116df tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:26.366646 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6e277a31-cde1-4ea5-9299-b020f7b96cbb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:26.371737 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-21aeb6de-14ab-4da2-bda2-c9d897d116df tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:26.376546 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6e277a31-cde1-4ea5-9299-b020f7b96cbb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:26.378095 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6e277a31-cde1-4ea5-9299-b020f7b96cbb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:26.378982 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-21aeb6de-14ab-4da2-bda2-c9d897d116df tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1192 microversion: 2.1 time: 0.081493 Feb 09 13:17:26.379372 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-6e277a31-cde1-4ea5-9299-b020f7b96cbb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1720 microversion: 2.20 time: 0.161120 Feb 09 13:17:26.379926 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 414/809] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:26 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1192 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:17:26.380189 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 396/810] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:26 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:17:27.397264 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-ed45b4d9-f95c-470c-ab20-d0d955ef05b8 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:27.403217 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-093224dc-608f-405b-aacd-e39e5665942e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:27.403896 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-ed45b4d9-f95c-470c-ab20-d0d955ef05b8 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:27.404438 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-093224dc-608f-405b-aacd-e39e5665942e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:27.410906 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-093224dc-608f-405b-aacd-e39e5665942e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:27.411597 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-093224dc-608f-405b-aacd-e39e5665942e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:27.412817 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-093224dc-608f-405b-aacd-e39e5665942e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:27.413563 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ed45b4d9-f95c-470c-ab20-d0d955ef05b8 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:27.413838 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-093224dc-608f-405b-aacd-e39e5665942e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:27.414021 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ed45b4d9-f95c-470c-ab20-d0d955ef05b8 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:27.415610 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ed45b4d9-f95c-470c-ab20-d0d955ef05b8 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:27.416057 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ed45b4d9-f95c-470c-ab20-d0d955ef05b8 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:27.479823 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ed45b4d9-f95c-470c-ab20-d0d955ef05b8 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:27.487280 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-ed45b4d9-f95c-470c-ab20-d0d955ef05b8 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1210 microversion: 2.1 time: 0.093823 Feb 09 13:17:27.487857 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 415/811] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:27 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:17:27.577230 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-093224dc-608f-405b-aacd-e39e5665942e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:27.585096 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-093224dc-608f-405b-aacd-e39e5665942e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:27.586689 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-093224dc-608f-405b-aacd-e39e5665942e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:27.590812 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-093224dc-608f-405b-aacd-e39e5665942e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1720 microversion: 2.20 time: 0.188741 Feb 09 13:17:27.590812 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 397/812] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:27 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1720 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:17:28.509337 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-85d0d555-b2ca-4cc8-ae35-24d3e2d2dc0a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:28.511311 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-85d0d555-b2ca-4cc8-ae35-24d3e2d2dc0a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:28.518040 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-85d0d555-b2ca-4cc8-ae35-24d3e2d2dc0a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:28.518497 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-85d0d555-b2ca-4cc8-ae35-24d3e2d2dc0a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:28.519338 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-85d0d555-b2ca-4cc8-ae35-24d3e2d2dc0a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:28.519778 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-85d0d555-b2ca-4cc8-ae35-24d3e2d2dc0a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:28.587275 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-946632e6-6870-4193-98fe-1d59e8e3c1c0 req-ac42f574-fd48-472a-8fae-20503842e894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "794b82e0-8aad-46b1-9e9e-9cfb0d16abf5", "tag": "cde48d4a-b667-4fb2-8210-2d6efb90a93a"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:17:28.588656 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:17:28.588656 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:17:28.597392 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-946632e6-6870-4193-98fe-1d59e8e3c1c0 req-ac42f574-fd48-472a-8fae-20503842e894 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:28.597838 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-946632e6-6870-4193-98fe-1d59e8e3c1c0 req-ac42f574-fd48-472a-8fae-20503842e894 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:28.615602 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-946632e6-6870-4193-98fe-1d59e8e3c1c0 req-ac42f574-fd48-472a-8fae-20503842e894 service nova] Creating event network-changed:cde48d4a-b667-4fb2-8210-2d6efb90a93a for instance 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 on hv-cinder-82786 Feb 09 13:17:28.621571 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-946632e6-6870-4193-98fe-1d59e8e3c1c0 req-ac42f574-fd48-472a-8fae-20503842e894 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041611 Feb 09 13:17:28.622487 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 398/813] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:17:28.636787 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-a1de3a07-9ee6-48b7-afb1-4f57064835af tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:28.638267 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-a1de3a07-9ee6-48b7-afb1-4f57064835af tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:28.645087 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a1de3a07-9ee6-48b7-afb1-4f57064835af tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:28.645604 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a1de3a07-9ee6-48b7-afb1-4f57064835af tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:28.651025 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a1de3a07-9ee6-48b7-afb1-4f57064835af tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:28.652812 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a1de3a07-9ee6-48b7-afb1-4f57064835af tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:28.713718 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-85d0d555-b2ca-4cc8-ae35-24d3e2d2dc0a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:28.724107 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-85d0d555-b2ca-4cc8-ae35-24d3e2d2dc0a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1265 microversion: 2.1 time: 0.221871 Feb 09 13:17:28.724877 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 416/814] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:28 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:17:28.935774 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-a1de3a07-9ee6-48b7-afb1-4f57064835af tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:28.943520 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-a1de3a07-9ee6-48b7-afb1-4f57064835af tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:28.945071 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-a1de3a07-9ee6-48b7-afb1-4f57064835af tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:28.946825 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-a1de3a07-9ee6-48b7-afb1-4f57064835af tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1720 microversion: 2.20 time: 0.322867 Feb 09 13:17:28.947398 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 399/815] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:28 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1720 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:17:29.741602 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-43450756-56f3-48d3-acde-ab8f2dcd85fe tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:29.742220 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-43450756-56f3-48d3-acde-ab8f2dcd85fe tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:29.748483 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-43450756-56f3-48d3-acde-ab8f2dcd85fe tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:29.748937 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-43450756-56f3-48d3-acde-ab8f2dcd85fe tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:29.749720 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-43450756-56f3-48d3-acde-ab8f2dcd85fe tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:29.750155 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-43450756-56f3-48d3-acde-ab8f2dcd85fe tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:29.882087 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-43450756-56f3-48d3-acde-ab8f2dcd85fe tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:29.889951 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-43450756-56f3-48d3-acde-ab8f2dcd85fe tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1265 microversion: 2.1 time: 0.152069 Feb 09 13:17:29.890526 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 417/816] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:29 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:17:29.965478 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-2bea7355-37cf-4f7d-95df-51319d418878 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:29.966080 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-2bea7355-37cf-4f7d-95df-51319d418878 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:29.972272 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2bea7355-37cf-4f7d-95df-51319d418878 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:29.972715 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2bea7355-37cf-4f7d-95df-51319d418878 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:29.973488 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2bea7355-37cf-4f7d-95df-51319d418878 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:29.973946 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2bea7355-37cf-4f7d-95df-51319d418878 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:30.027279 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-ae64ad8c-79d3-4593-845f-2b0f88e87343 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:30.027876 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-ae64ad8c-79d3-4593-845f-2b0f88e87343 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:30.034588 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ae64ad8c-79d3-4593-845f-2b0f88e87343 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:30.038330 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ae64ad8c-79d3-4593-845f-2b0f88e87343 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:30.038330 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ae64ad8c-79d3-4593-845f-2b0f88e87343 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:30.038330 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ae64ad8c-79d3-4593-845f-2b0f88e87343 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:30.066435 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-ae64ad8c-79d3-4593-845f-2b0f88e87343 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-volume_attachments/6582ef49-c114-4a9a-8bc5-6b7ddcfde5ff" status: 200 len: 194 microversion: 2.1 time: 0.043865 Feb 09 13:17:30.071284 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 418/817] 10.222.0.84 () {58 vars in 1412 bytes} [Wed Feb 9 13:17:30 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-volume_attachments/6582ef49-c114-4a9a-8bc5-6b7ddcfde5ff => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:17:30.076606 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-7638ba90-59fc-4643-8a24-9b9eda9221c0 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:30.077174 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-7638ba90-59fc-4643-8a24-9b9eda9221c0 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:30.082894 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7638ba90-59fc-4643-8a24-9b9eda9221c0 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:30.083362 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7638ba90-59fc-4643-8a24-9b9eda9221c0 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:30.084133 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7638ba90-59fc-4643-8a24-9b9eda9221c0 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:30.084572 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7638ba90-59fc-4643-8a24-9b9eda9221c0 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:30.111686 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-2bea7355-37cf-4f7d-95df-51319d418878 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:30.119998 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-2bea7355-37cf-4f7d-95df-51319d418878 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:30.121496 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-2bea7355-37cf-4f7d-95df-51319d418878 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:30.122658 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-2bea7355-37cf-4f7d-95df-51319d418878 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1720 microversion: 2.20 time: 0.161778 Feb 09 13:17:30.123212 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 400/818] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:29 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:17:30.162089 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-7638ba90-59fc-4643-8a24-9b9eda9221c0 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lazy-loading 'services' on Instance uuid 84445fb8-4a25-468e-a8ad-e060b55105a2 {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:17:30.369397 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-7638ba90-59fc-4643-8a24-9b9eda9221c0 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "DELETE /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-volume_attachments/6582ef49-c114-4a9a-8bc5-6b7ddcfde5ff" status: 202 len: 0 microversion: 2.1 time: 0.295611 Feb 09 13:17:30.369914 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 419/819] 10.222.0.84 () {58 vars in 1415 bytes} [Wed Feb 9 13:17:30 2022] DELETE /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-volume_attachments/6582ef49-c114-4a9a-8bc5-6b7ddcfde5ff => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 09 13:17:30.917676 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-b55502ce-12af-426c-9b9b-0d969c218cc3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:30.917676 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-b55502ce-12af-426c-9b9b-0d969c218cc3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:30.917676 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b55502ce-12af-426c-9b9b-0d969c218cc3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:30.917676 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b55502ce-12af-426c-9b9b-0d969c218cc3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:30.918168 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b55502ce-12af-426c-9b9b-0d969c218cc3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:30.918168 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b55502ce-12af-426c-9b9b-0d969c218cc3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:31.047419 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-b55502ce-12af-426c-9b9b-0d969c218cc3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:31.054604 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-b55502ce-12af-426c-9b9b-0d969c218cc3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1265 microversion: 2.1 time: 0.151441 Feb 09 13:17:31.055177 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 401/820] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:30 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:17:31.240467 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-aaa66ce7-e1af-42bd-bdda-e5a2e7e5e71d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:31.241159 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-aaa66ce7-e1af-42bd-bdda-e5a2e7e5e71d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:31.247070 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-aaa66ce7-e1af-42bd-bdda-e5a2e7e5e71d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:31.247510 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-aaa66ce7-e1af-42bd-bdda-e5a2e7e5e71d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:31.248279 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-aaa66ce7-e1af-42bd-bdda-e5a2e7e5e71d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:31.248712 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-aaa66ce7-e1af-42bd-bdda-e5a2e7e5e71d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:31.390617 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-aaa66ce7-e1af-42bd-bdda-e5a2e7e5e71d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:31.398319 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-aaa66ce7-e1af-42bd-bdda-e5a2e7e5e71d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:31.400452 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-aaa66ce7-e1af-42bd-bdda-e5a2e7e5e71d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:31.401733 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-aaa66ce7-e1af-42bd-bdda-e5a2e7e5e71d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1720 microversion: 2.20 time: 0.264260 Feb 09 13:17:31.402583 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 420/821] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:31 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1720 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:17:32.071414 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-246b4029-a22c-4740-a27b-559c0acc6d1b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:32.072027 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-246b4029-a22c-4740-a27b-559c0acc6d1b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:32.078547 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-246b4029-a22c-4740-a27b-559c0acc6d1b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:32.079062 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-246b4029-a22c-4740-a27b-559c0acc6d1b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:32.080649 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-246b4029-a22c-4740-a27b-559c0acc6d1b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:32.081121 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-246b4029-a22c-4740-a27b-559c0acc6d1b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:32.218094 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-246b4029-a22c-4740-a27b-559c0acc6d1b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:32.225345 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-246b4029-a22c-4740-a27b-559c0acc6d1b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1265 microversion: 2.1 time: 0.157765 Feb 09 13:17:32.225914 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 402/822] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:32 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:17:32.423430 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-a2ebc8ea-4567-42c6-b9ba-dfa62c1cd293 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:32.425051 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-a2ebc8ea-4567-42c6-b9ba-dfa62c1cd293 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:32.431733 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a2ebc8ea-4567-42c6-b9ba-dfa62c1cd293 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:32.432191 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a2ebc8ea-4567-42c6-b9ba-dfa62c1cd293 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:32.432990 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a2ebc8ea-4567-42c6-b9ba-dfa62c1cd293 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:32.433435 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a2ebc8ea-4567-42c6-b9ba-dfa62c1cd293 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:32.537153 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-db6bfae2-915d-48f7-888c-c4299e988d1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:32.537651 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-db6bfae2-915d-48f7-888c-c4299e988d1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:32.543986 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-db6bfae2-915d-48f7-888c-c4299e988d1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:32.544443 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-db6bfae2-915d-48f7-888c-c4299e988d1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:32.545235 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-db6bfae2-915d-48f7-888c-c4299e988d1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:32.545680 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-db6bfae2-915d-48f7-888c-c4299e988d1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:32.565351 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a2ebc8ea-4567-42c6-b9ba-dfa62c1cd293 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:32.573122 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a2ebc8ea-4567-42c6-b9ba-dfa62c1cd293 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:32.574648 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a2ebc8ea-4567-42c6-b9ba-dfa62c1cd293 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:32.575823 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-a2ebc8ea-4567-42c6-b9ba-dfa62c1cd293 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1720 microversion: 2.20 time: 0.156214 Feb 09 13:17:32.576863 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 421/823] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:32 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:17:32.578912 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-db6bfae2-915d-48f7-888c-c4299e988d1d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-volume_attachments/d92d6aed-560d-492c-95b4-24ffcf14bda2" status: 200 len: 194 microversion: 2.1 time: 0.045412 Feb 09 13:17:32.579517 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 403/824] 10.222.0.84 () {58 vars in 1412 bytes} [Wed Feb 9 13:17:32 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-volume_attachments/d92d6aed-560d-492c-95b4-24ffcf14bda2 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:17:32.589178 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-19ac9f9b-ab02-4b5e-a330-1b5de872edda tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:32.589701 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-19ac9f9b-ab02-4b5e-a330-1b5de872edda tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:32.595601 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-19ac9f9b-ab02-4b5e-a330-1b5de872edda tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:32.596053 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-19ac9f9b-ab02-4b5e-a330-1b5de872edda tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:32.596837 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-19ac9f9b-ab02-4b5e-a330-1b5de872edda tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:32.597275 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-19ac9f9b-ab02-4b5e-a330-1b5de872edda tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:32.675187 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-19ac9f9b-ab02-4b5e-a330-1b5de872edda tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lazy-loading 'services' on Instance uuid 84445fb8-4a25-468e-a8ad-e060b55105a2 {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:17:32.911191 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-19ac9f9b-ab02-4b5e-a330-1b5de872edda tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "DELETE /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-volume_attachments/d92d6aed-560d-492c-95b4-24ffcf14bda2" status: 202 len: 0 microversion: 2.1 time: 0.325913 Feb 09 13:17:32.911771 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 422/825] 10.222.0.84 () {58 vars in 1415 bytes} [Wed Feb 9 13:17:32 2022] DELETE /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-volume_attachments/d92d6aed-560d-492c-95b4-24ffcf14bda2 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:17:33.241546 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-43182193-f71e-4dfe-8967-0761f8439813 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:33.242186 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-43182193-f71e-4dfe-8967-0761f8439813 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:33.248915 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-43182193-f71e-4dfe-8967-0761f8439813 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:33.249363 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-43182193-f71e-4dfe-8967-0761f8439813 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:33.250140 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-43182193-f71e-4dfe-8967-0761f8439813 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:33.250596 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-43182193-f71e-4dfe-8967-0761f8439813 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:33.381488 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-43182193-f71e-4dfe-8967-0761f8439813 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:33.389328 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-43182193-f71e-4dfe-8967-0761f8439813 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1265 microversion: 2.1 time: 0.151419 Feb 09 13:17:33.389901 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 404/826] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:33 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:17:33.593968 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-789e3cd1-abe9-4722-a328-b0de7d35fef5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:33.594703 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-789e3cd1-abe9-4722-a328-b0de7d35fef5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:33.601041 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-789e3cd1-abe9-4722-a328-b0de7d35fef5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:33.601498 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-789e3cd1-abe9-4722-a328-b0de7d35fef5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:33.602287 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-789e3cd1-abe9-4722-a328-b0de7d35fef5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:33.603272 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-789e3cd1-abe9-4722-a328-b0de7d35fef5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:33.737335 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-789e3cd1-abe9-4722-a328-b0de7d35fef5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:33.745713 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-789e3cd1-abe9-4722-a328-b0de7d35fef5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:33.747244 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-789e3cd1-abe9-4722-a328-b0de7d35fef5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:33.748461 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-789e3cd1-abe9-4722-a328-b0de7d35fef5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1720 microversion: 2.20 time: 0.159002 Feb 09 13:17:33.749022 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 423/827] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:33 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:17:34.070083 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-7ceb4290-a6b8-409e-bcc6-0646b2b8a5bb tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:34.071036 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-7ceb4290-a6b8-409e-bcc6-0646b2b8a5bb tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:34.076845 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7ceb4290-a6b8-409e-bcc6-0646b2b8a5bb tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:34.077294 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7ceb4290-a6b8-409e-bcc6-0646b2b8a5bb tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:34.078075 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7ceb4290-a6b8-409e-bcc6-0646b2b8a5bb tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:34.078542 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7ceb4290-a6b8-409e-bcc6-0646b2b8a5bb tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:34.108349 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-7ceb4290-a6b8-409e-bcc6-0646b2b8a5bb tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041885 Feb 09 13:17:34.108904 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 405/828] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:17:34 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 09 13:17:34.215754 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-3dcc09c3-1cd9-4121-a006-45799a4b003a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:34.216848 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-3dcc09c3-1cd9-4121-a006-45799a4b003a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:34.223678 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3dcc09c3-1cd9-4121-a006-45799a4b003a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:34.223678 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3dcc09c3-1cd9-4121-a006-45799a4b003a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:34.224086 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3dcc09c3-1cd9-4121-a006-45799a4b003a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:34.224587 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3dcc09c3-1cd9-4121-a006-45799a4b003a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:34.252843 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-3dcc09c3-1cd9-4121-a006-45799a4b003a tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041632 Feb 09 13:17:34.253394 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 424/829] 10.222.0.84 () {58 vars in 1301 bytes} [Wed Feb 9 13:17:34 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 09 13:17:34.316351 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d94652a9-6d7e-4a83-b5c4-ced30f0aea49 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:34.316854 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d94652a9-6d7e-4a83-b5c4-ced30f0aea49 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:34.323000 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d94652a9-6d7e-4a83-b5c4-ced30f0aea49 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:34.323954 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d94652a9-6d7e-4a83-b5c4-ced30f0aea49 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:34.324729 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d94652a9-6d7e-4a83-b5c4-ced30f0aea49 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:34.325160 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d94652a9-6d7e-4a83-b5c4-ced30f0aea49 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:34.349418 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d94652a9-6d7e-4a83-b5c4-ced30f0aea49 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Going to try to terminate instance {{(pid=116749) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 09 13:17:34.406025 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-98b6d9af-0073-4d1c-b8e5-2ca6b5a93f1b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:34.406673 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-98b6d9af-0073-4d1c-b8e5-2ca6b5a93f1b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:34.412482 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-98b6d9af-0073-4d1c-b8e5-2ca6b5a93f1b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:34.412936 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-98b6d9af-0073-4d1c-b8e5-2ca6b5a93f1b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:34.413723 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-98b6d9af-0073-4d1c-b8e5-2ca6b5a93f1b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:34.414166 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-98b6d9af-0073-4d1c-b8e5-2ca6b5a93f1b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:34.552096 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-98b6d9af-0073-4d1c-b8e5-2ca6b5a93f1b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:34.559964 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-98b6d9af-0073-4d1c-b8e5-2ca6b5a93f1b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1265 microversion: 2.1 time: 0.158560 Feb 09 13:17:34.561696 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 425/830] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:34 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:17:34.699408 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d94652a9-6d7e-4a83-b5c4-ced30f0aea49 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "DELETE /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2" status: 204 len: 0 microversion: 2.1 time: 0.386399 Feb 09 13:17:34.700111 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 406/831] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:17:34 2022] DELETE /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 09 13:17:34.708368 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-eb31a7c2-0c88-4877-81d4-d42657c1d32e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:34.708981 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-eb31a7c2-0c88-4877-81d4-d42657c1d32e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:34.715900 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-eb31a7c2-0c88-4877-81d4-d42657c1d32e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:34.716351 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-eb31a7c2-0c88-4877-81d4-d42657c1d32e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:34.717237 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-eb31a7c2-0c88-4877-81d4-d42657c1d32e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:34.717699 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-eb31a7c2-0c88-4877-81d4-d42657c1d32e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:34.767750 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-6e751815-ec7e-4a37-af77-0358068d30b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:34.768346 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-6e751815-ec7e-4a37-af77-0358068d30b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:34.774434 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6e751815-ec7e-4a37-af77-0358068d30b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:34.774963 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6e751815-ec7e-4a37-af77-0358068d30b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:34.776061 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6e751815-ec7e-4a37-af77-0358068d30b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:34.776187 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6e751815-ec7e-4a37-af77-0358068d30b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:34.865392 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-eb31a7c2-0c88-4877-81d4-d42657c1d32e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:34.873545 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-eb31a7c2-0c88-4877-81d4-d42657c1d32e tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2" status: 200 len: 1675 microversion: 2.1 time: 0.168829 Feb 09 13:17:34.874173 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 426/832] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:34 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:17:34.918793 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6e751815-ec7e-4a37-af77-0358068d30b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:34.926516 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6e751815-ec7e-4a37-af77-0358068d30b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:34.928096 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6e751815-ec7e-4a37-af77-0358068d30b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:34.929233 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-6e751815-ec7e-4a37-af77-0358068d30b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1741 microversion: 2.20 time: 0.166028 Feb 09 13:17:34.929783 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 407/833] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:34 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:17:35.577356 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-df8d4d64-e3f1-4817-a57c-dc7f743fb456 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:35.577891 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-df8d4d64-e3f1-4817-a57c-dc7f743fb456 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:35.583855 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-df8d4d64-e3f1-4817-a57c-dc7f743fb456 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:35.584311 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-df8d4d64-e3f1-4817-a57c-dc7f743fb456 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:35.585093 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-df8d4d64-e3f1-4817-a57c-dc7f743fb456 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:35.585535 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-df8d4d64-e3f1-4817-a57c-dc7f743fb456 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:35.721222 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-df8d4d64-e3f1-4817-a57c-dc7f743fb456 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:35.728340 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-df8d4d64-e3f1-4817-a57c-dc7f743fb456 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1265 microversion: 2.1 time: 0.155259 Feb 09 13:17:35.728906 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 427/834] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:35 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:17:35.896960 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-599a682f-e9ae-42e5-9046-70da70bf2ac5 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:35.897485 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-599a682f-e9ae-42e5-9046-70da70bf2ac5 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:35.904107 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-599a682f-e9ae-42e5-9046-70da70bf2ac5 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:35.904562 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-599a682f-e9ae-42e5-9046-70da70bf2ac5 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:35.905352 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-599a682f-e9ae-42e5-9046-70da70bf2ac5 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:35.905789 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-599a682f-e9ae-42e5-9046-70da70bf2ac5 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:35.947779 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-e76f4f93-c2f0-4074-9686-b1fa9127e7e3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:35.948395 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-e76f4f93-c2f0-4074-9686-b1fa9127e7e3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:35.954108 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e76f4f93-c2f0-4074-9686-b1fa9127e7e3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:35.954578 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e76f4f93-c2f0-4074-9686-b1fa9127e7e3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:35.955394 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e76f4f93-c2f0-4074-9686-b1fa9127e7e3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:35.955831 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e76f4f93-c2f0-4074-9686-b1fa9127e7e3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:36.042613 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-599a682f-e9ae-42e5-9046-70da70bf2ac5 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:36.050041 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-599a682f-e9ae-42e5-9046-70da70bf2ac5 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2" status: 200 len: 1675 microversion: 2.1 time: 0.156842 Feb 09 13:17:36.050640 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 408/835] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:35 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:17:36.086998 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e76f4f93-c2f0-4074-9686-b1fa9127e7e3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:36.094953 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e76f4f93-c2f0-4074-9686-b1fa9127e7e3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:36.096492 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e76f4f93-c2f0-4074-9686-b1fa9127e7e3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:36.097635 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-e76f4f93-c2f0-4074-9686-b1fa9127e7e3 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1741 microversion: 2.20 time: 0.153553 Feb 09 13:17:36.098186 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 428/836] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:35 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:17:36.745380 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-007e8988-a55e-4759-a4db-adeeca0efff9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:36.745995 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-007e8988-a55e-4759-a4db-adeeca0efff9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:36.751889 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-007e8988-a55e-4759-a4db-adeeca0efff9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:36.752349 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-007e8988-a55e-4759-a4db-adeeca0efff9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:36.756199 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-007e8988-a55e-4759-a4db-adeeca0efff9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:36.756199 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-007e8988-a55e-4759-a4db-adeeca0efff9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:36.889917 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-007e8988-a55e-4759-a4db-adeeca0efff9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:36.897356 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-007e8988-a55e-4759-a4db-adeeca0efff9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1265 microversion: 2.1 time: 0.155890 Feb 09 13:17:36.897951 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 409/837] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:36 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:17:37.067025 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-1724166d-118c-4c17-b60f-afbc2cabd72d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:37.067874 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-1724166d-118c-4c17-b60f-afbc2cabd72d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:37.074463 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1724166d-118c-4c17-b60f-afbc2cabd72d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:37.074946 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1724166d-118c-4c17-b60f-afbc2cabd72d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:37.075863 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1724166d-118c-4c17-b60f-afbc2cabd72d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:37.076404 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1724166d-118c-4c17-b60f-afbc2cabd72d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:37.115659 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d48cb4eb-c128-4d1a-8030-4fd3f4ba16e9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:37.116275 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d48cb4eb-c128-4d1a-8030-4fd3f4ba16e9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:37.122508 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d48cb4eb-c128-4d1a-8030-4fd3f4ba16e9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:37.122984 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d48cb4eb-c128-4d1a-8030-4fd3f4ba16e9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:37.124085 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d48cb4eb-c128-4d1a-8030-4fd3f4ba16e9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:37.124422 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d48cb4eb-c128-4d1a-8030-4fd3f4ba16e9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:37.224712 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-1724166d-118c-4c17-b60f-afbc2cabd72d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:37.237327 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-1724166d-118c-4c17-b60f-afbc2cabd72d tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2" status: 200 len: 1675 microversion: 2.1 time: 0.173852 Feb 09 13:17:37.238105 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 429/838] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:37 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2 => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:17:37.364178 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-d48cb4eb-c128-4d1a-8030-4fd3f4ba16e9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:37.372996 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-d48cb4eb-c128-4d1a-8030-4fd3f4ba16e9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:37.374502 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-d48cb4eb-c128-4d1a-8030-4fd3f4ba16e9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:37.375788 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d48cb4eb-c128-4d1a-8030-4fd3f4ba16e9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1736 microversion: 2.20 time: 0.263845 Feb 09 13:17:37.376331 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 410/839] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:37 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1736 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:17:37.914475 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-8fc37fd4-e0a6-4474-bb9c-37a7972d7bf9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:37.915239 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-8fc37fd4-e0a6-4474-bb9c-37a7972d7bf9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:37.925601 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8fc37fd4-e0a6-4474-bb9c-37a7972d7bf9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:37.926307 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8fc37fd4-e0a6-4474-bb9c-37a7972d7bf9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:37.928180 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8fc37fd4-e0a6-4474-bb9c-37a7972d7bf9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:37.928803 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8fc37fd4-e0a6-4474-bb9c-37a7972d7bf9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:38.119216 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-8fc37fd4-e0a6-4474-bb9c-37a7972d7bf9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:38.133857 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-8fc37fd4-e0a6-4474-bb9c-37a7972d7bf9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1265 microversion: 2.1 time: 0.217312 Feb 09 13:17:38.133857 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 430/840] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:37 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:17:38.257358 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-700f6648-ba4b-4e26-9ce2-932f1ca92331 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:38.269212 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-700f6648-ba4b-4e26-9ce2-932f1ca92331 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:38.294930 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-700f6648-ba4b-4e26-9ce2-932f1ca92331 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:38.296772 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-700f6648-ba4b-4e26-9ce2-932f1ca92331 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:38.300970 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-700f6648-ba4b-4e26-9ce2-932f1ca92331 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:38.303045 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-700f6648-ba4b-4e26-9ce2-932f1ca92331 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:38.317137 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-5c665c70-2015-4178-b41f-47a51de46c52 req-b105cc65-7e23-4943-931a-c9c5e546666b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84445fb8-4a25-468e-a8ad-e060b55105a2", "name": "network-vif-deleted", "tag": "fb9e09f7-4b57-4b24-ae7e-ae897c352559"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:17:38.319099 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:17:38.319099 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:17:38.334436 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-5c665c70-2015-4178-b41f-47a51de46c52 req-b105cc65-7e23-4943-931a-c9c5e546666b service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:38.335197 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-5c665c70-2015-4178-b41f-47a51de46c52 req-b105cc65-7e23-4943-931a-c9c5e546666b service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:38.356856 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-5c665c70-2015-4178-b41f-47a51de46c52 req-b105cc65-7e23-4943-931a-c9c5e546666b service nova] Creating event network-vif-deleted:fb9e09f7-4b57-4b24-ae7e-ae897c352559 for instance 84445fb8-4a25-468e-a8ad-e060b55105a2 on hv-cinder-82786 Feb 09 13:17:38.362091 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-5c665c70-2015-4178-b41f-47a51de46c52 req-b105cc65-7e23-4943-931a-c9c5e546666b service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048802 Feb 09 13:17:38.367023 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 431/841] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:17:38.396293 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-6b147179-caeb-41e4-95a9-a15183a6fe21 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:38.397075 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-6b147179-caeb-41e4-95a9-a15183a6fe21 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:38.409268 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6b147179-caeb-41e4-95a9-a15183a6fe21 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:38.410055 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6b147179-caeb-41e4-95a9-a15183a6fe21 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:38.411174 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6b147179-caeb-41e4-95a9-a15183a6fe21 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:38.411838 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6b147179-caeb-41e4-95a9-a15183a6fe21 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:38.415452 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-700f6648-ba4b-4e26-9ce2-932f1ca92331 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdb5b8deadf447da675e9a24395a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413094dda74649c282bf36d27168fc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:38.423887 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-700f6648-ba4b-4e26-9ce2-932f1ca92331 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2" status: 200 len: 1607 microversion: 2.1 time: 0.172528 Feb 09 13:17:38.427448 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 411/842] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:38 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2 => generated 1607 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:17:38.653870 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6b147179-caeb-41e4-95a9-a15183a6fe21 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:38.663264 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6b147179-caeb-41e4-95a9-a15183a6fe21 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:38.671120 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6b147179-caeb-41e4-95a9-a15183a6fe21 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:38.672836 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-6b147179-caeb-41e4-95a9-a15183a6fe21 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1736 microversion: 2.20 time: 0.280920 Feb 09 13:17:38.673809 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 432/843] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:38 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1736 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:17:39.145311 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-b8adaf06-0874-4c16-bbdb-f3ca5d1cd649 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:39.146323 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-b8adaf06-0874-4c16-bbdb-f3ca5d1cd649 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:39.154048 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b8adaf06-0874-4c16-bbdb-f3ca5d1cd649 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:39.154766 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b8adaf06-0874-4c16-bbdb-f3ca5d1cd649 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:39.155851 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b8adaf06-0874-4c16-bbdb-f3ca5d1cd649 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:39.156527 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b8adaf06-0874-4c16-bbdb-f3ca5d1cd649 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:39.349232 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-4f7827f1-2070-4757-a924-960abc3db6f5 req-c48b54f5-800d-4a73-ba07-ee004ac52314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece0c49e-784a-49c1-85c1-de2a95a93e00", "name": "network-vif-plugged", "status": "completed", "tag": "8fc972e9-0cc0-429d-a82a-fd959fe8f9d3"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:17:39.352945 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:17:39.352945 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:17:39.372304 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-4f7827f1-2070-4757-a924-960abc3db6f5 req-c48b54f5-800d-4a73-ba07-ee004ac52314 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:39.376686 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-4f7827f1-2070-4757-a924-960abc3db6f5 req-c48b54f5-800d-4a73-ba07-ee004ac52314 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:39.379948 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-b8adaf06-0874-4c16-bbdb-f3ca5d1cd649 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:39.390403 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-4f7827f1-2070-4757-a924-960abc3db6f5 req-c48b54f5-800d-4a73-ba07-ee004ac52314 service nova] Creating event network-vif-plugged:8fc972e9-0cc0-429d-a82a-fd959fe8f9d3 for instance ece0c49e-784a-49c1-85c1-de2a95a93e00 on hv-cinder-82786 Feb 09 13:17:39.392566 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-b8adaf06-0874-4c16-bbdb-f3ca5d1cd649 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1265 microversion: 2.1 time: 0.250846 Feb 09 13:17:39.395364 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 412/844] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:39 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:17:39.397311 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-4f7827f1-2070-4757-a924-960abc3db6f5 req-c48b54f5-800d-4a73-ba07-ee004ac52314 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181284 Feb 09 13:17:39.398403 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 433/845] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:17:39.445407 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-f06c408f-137a-4f19-9717-bd11b0392fc9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:39.447201 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-f06c408f-137a-4f19-9717-bd11b0392fc9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:39.460987 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f06c408f-137a-4f19-9717-bd11b0392fc9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:39.461905 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f06c408f-137a-4f19-9717-bd11b0392fc9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:39.469112 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f06c408f-137a-4f19-9717-bd11b0392fc9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:39.469948 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f06c408f-137a-4f19-9717-bd11b0392fc9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:39.485592 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-f06c408f-137a-4f19-9717-bd11b0392fc9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] HTTP exception thrown: Instance 84445fb8-4a25-468e-a8ad-e060b55105a2 could not be found. Feb 09 13:17:39.486623 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-f06c408f-137a-4f19-9717-bd11b0392fc9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Returning 404 to user: Instance 84445fb8-4a25-468e-a8ad-e060b55105a2 could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:17:39.490952 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-f06c408f-137a-4f19-9717-bd11b0392fc9 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2" status: 404 len: 111 microversion: 2.1 time: 0.046412 Feb 09 13:17:39.490952 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 413/846] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:39 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:17:39.497835 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-eb9245c4-e3b2-4acc-89fe-475323c63386 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '.version_select at 0x7f7f64538790>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:39.616512 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-eb9245c4-e3b2-4acc-89fe-475323c63386 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1894228934" status: 202 len: 0 microversion: 2.1 time: 0.123466 Feb 09 13:17:39.630338 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 434/847] 10.222.0.84 () {58 vars in 1220 bytes} [Wed Feb 9 13:17:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1894228934 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:17:39.692545 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-726a00d1-8365-4195-9828-11113f507fd7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:39.693192 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-726a00d1-8365-4195-9828-11113f507fd7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:39.703516 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-726a00d1-8365-4195-9828-11113f507fd7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:39.705459 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-726a00d1-8365-4195-9828-11113f507fd7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:39.706575 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-726a00d1-8365-4195-9828-11113f507fd7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:39.710084 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-726a00d1-8365-4195-9828-11113f507fd7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:39.885071 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-726a00d1-8365-4195-9828-11113f507fd7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:39.896832 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-726a00d1-8365-4195-9828-11113f507fd7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:39.899053 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-726a00d1-8365-4195-9828-11113f507fd7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:39.900474 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-726a00d1-8365-4195-9828-11113f507fd7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1736 microversion: 2.20 time: 0.212163 Feb 09 13:17:39.917073 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 414/848] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:39 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:17:40.413272 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-72a76168-78ba-486f-960d-46119532017e tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:40.414653 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-72a76168-78ba-486f-960d-46119532017e tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:40.424494 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-72a76168-78ba-486f-960d-46119532017e tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:40.424944 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-72a76168-78ba-486f-960d-46119532017e tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:40.425753 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-72a76168-78ba-486f-960d-46119532017e tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:40.426189 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-72a76168-78ba-486f-960d-46119532017e tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:40.723525 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-72a76168-78ba-486f-960d-46119532017e tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:40.735215 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-72a76168-78ba-486f-960d-46119532017e tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1265 microversion: 2.1 time: 0.325468 Feb 09 13:17:40.735824 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 435/849] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:40 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1265 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:17:40.923034 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c06a3b65-5e3b-4740-baaa-634c30e562fd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:40.924346 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-c06a3b65-5e3b-4740-baaa-634c30e562fd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:40.931296 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c06a3b65-5e3b-4740-baaa-634c30e562fd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:40.931747 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c06a3b65-5e3b-4740-baaa-634c30e562fd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:40.932580 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c06a3b65-5e3b-4740-baaa-634c30e562fd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:40.933181 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c06a3b65-5e3b-4740-baaa-634c30e562fd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:41.081424 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c06a3b65-5e3b-4740-baaa-634c30e562fd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:41.090583 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c06a3b65-5e3b-4740-baaa-634c30e562fd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:41.092273 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c06a3b65-5e3b-4740-baaa-634c30e562fd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:41.093578 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c06a3b65-5e3b-4740-baaa-634c30e562fd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1736 microversion: 2.20 time: 0.177146 Feb 09 13:17:41.094231 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 415/850] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:40 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:17:41.752227 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-bc242622-11fd-483e-b8f0-9ad15ec55617 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:41.752843 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-bc242622-11fd-483e-b8f0-9ad15ec55617 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:41.772005 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bc242622-11fd-483e-b8f0-9ad15ec55617 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:41.772466 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bc242622-11fd-483e-b8f0-9ad15ec55617 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:41.773341 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bc242622-11fd-483e-b8f0-9ad15ec55617 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:41.775744 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bc242622-11fd-483e-b8f0-9ad15ec55617 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:41.966778 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-bc242622-11fd-483e-b8f0-9ad15ec55617 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:41.975261 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-bc242622-11fd-483e-b8f0-9ad15ec55617 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1265 microversion: 2.1 time: 0.226643 Feb 09 13:17:41.976174 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 436/851] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:41 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:17:42.112087 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-42c6a228-4869-4034-af3b-9134d9186581 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:42.112926 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-42c6a228-4869-4034-af3b-9134d9186581 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:42.119826 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-42c6a228-4869-4034-af3b-9134d9186581 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:42.120300 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-42c6a228-4869-4034-af3b-9134d9186581 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:42.121972 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-42c6a228-4869-4034-af3b-9134d9186581 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:42.122645 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-42c6a228-4869-4034-af3b-9134d9186581 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:42.321864 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-42c6a228-4869-4034-af3b-9134d9186581 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:42.330035 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-42c6a228-4869-4034-af3b-9134d9186581 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:42.331667 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-42c6a228-4869-4034-af3b-9134d9186581 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:42.332860 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-42c6a228-4869-4034-af3b-9134d9186581 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1736 microversion: 2.20 time: 0.224528 Feb 09 13:17:42.333579 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 416/852] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:42 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:17:42.869749 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-950ccf98-9665-429d-8785-b5cb5a65f499 req-c5ef032b-51d4-4d5c-a0d9-a3cb47612549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "794b82e0-8aad-46b1-9e9e-9cfb0d16abf5", "name": "network-vif-plugged", "status": "completed", "tag": "cde48d4a-b667-4fb2-8210-2d6efb90a93a"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:17:42.872886 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:17:42.872886 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:17:42.888427 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-950ccf98-9665-429d-8785-b5cb5a65f499 req-c5ef032b-51d4-4d5c-a0d9-a3cb47612549 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:42.888919 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-950ccf98-9665-429d-8785-b5cb5a65f499 req-c5ef032b-51d4-4d5c-a0d9-a3cb47612549 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:42.903314 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-950ccf98-9665-429d-8785-b5cb5a65f499 req-c5ef032b-51d4-4d5c-a0d9-a3cb47612549 service nova] Creating event network-vif-plugged:cde48d4a-b667-4fb2-8210-2d6efb90a93a for instance 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 on hv-cinder-82786 Feb 09 13:17:42.908201 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-950ccf98-9665-429d-8785-b5cb5a65f499 req-c5ef032b-51d4-4d5c-a0d9-a3cb47612549 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043321 Feb 09 13:17:42.909043 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 437/853] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:17:42.996753 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-92d56c57-5756-448b-8b5b-fe37098757cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:42.997708 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-92d56c57-5756-448b-8b5b-fe37098757cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:43.005713 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-92d56c57-5756-448b-8b5b-fe37098757cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:43.006549 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-92d56c57-5756-448b-8b5b-fe37098757cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:43.007645 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-92d56c57-5756-448b-8b5b-fe37098757cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:43.008380 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-92d56c57-5756-448b-8b5b-fe37098757cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:43.182314 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-92d56c57-5756-448b-8b5b-fe37098757cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:43.191395 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-92d56c57-5756-448b-8b5b-fe37098757cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1265 microversion: 2.1 time: 0.198872 Feb 09 13:17:43.192867 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 417/854] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:42 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:17:43.352963 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-2d5bdfa9-1246-436b-979f-4485840aa9e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:43.354121 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-2d5bdfa9-1246-436b-979f-4485840aa9e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:43.366291 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2d5bdfa9-1246-436b-979f-4485840aa9e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:43.367159 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2d5bdfa9-1246-436b-979f-4485840aa9e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:43.368178 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2d5bdfa9-1246-436b-979f-4485840aa9e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:43.369013 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2d5bdfa9-1246-436b-979f-4485840aa9e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:43.563091 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c5374a17-c810-4343-aa89-85dc7d226ce2 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:43.564088 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-c5374a17-c810-4343-aa89-85dc7d226ce2 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:43.571070 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c5374a17-c810-4343-aa89-85dc7d226ce2 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:43.575555 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c5374a17-c810-4343-aa89-85dc7d226ce2 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:43.575555 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c5374a17-c810-4343-aa89-85dc7d226ce2 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:43.575555 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c5374a17-c810-4343-aa89-85dc7d226ce2 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:43.600511 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-c5374a17-c810-4343-aa89-85dc7d226ce2 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] HTTP exception thrown: Instance 84445fb8-4a25-468e-a8ad-e060b55105a2 could not be found. Feb 09 13:17:43.601537 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c5374a17-c810-4343-aa89-85dc7d226ce2 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Returning 404 to user: Instance 84445fb8-4a25-468e-a8ad-e060b55105a2 could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:17:43.602414 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c5374a17-c810-4343-aa89-85dc7d226ce2 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "DELETE /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2" status: 404 len: 111 microversion: 2.1 time: 0.042991 Feb 09 13:17:43.606676 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 418/855] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:17:43 2022] DELETE /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:17:43.611149 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d2d9c57a-8b73-4a41-a8c0-8b9f5de6e8a4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:43.611763 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d2d9c57a-8b73-4a41-a8c0-8b9f5de6e8a4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 84445fb8-4a25-468e-a8ad-e060b55105a2] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:43.618811 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d2d9c57a-8b73-4a41-a8c0-8b9f5de6e8a4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:43.619497 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d2d9c57a-8b73-4a41-a8c0-8b9f5de6e8a4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:43.620504 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d2d9c57a-8b73-4a41-a8c0-8b9f5de6e8a4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:43.621136 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d2d9c57a-8b73-4a41-a8c0-8b9f5de6e8a4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:43.637000 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-d2d9c57a-8b73-4a41-a8c0-8b9f5de6e8a4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] HTTP exception thrown: Instance 84445fb8-4a25-468e-a8ad-e060b55105a2 could not be found. Feb 09 13:17:43.637602 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d2d9c57a-8b73-4a41-a8c0-8b9f5de6e8a4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Returning 404 to user: Instance 84445fb8-4a25-468e-a8ad-e060b55105a2 could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:17:43.638443 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d2d9c57a-8b73-4a41-a8c0-8b9f5de6e8a4 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2" status: 404 len: 111 microversion: 2.1 time: 0.030854 Feb 09 13:17:43.639038 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 419/856] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:43 2022] GET /compute/v2.1/servers/84445fb8-4a25-468e-a8ad-e060b55105a2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:17:43.736733 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-2d5bdfa9-1246-436b-979f-4485840aa9e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:43.745214 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-2d5bdfa9-1246-436b-979f-4485840aa9e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:43.748401 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-2d5bdfa9-1246-436b-979f-4485840aa9e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:43.750232 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-2d5bdfa9-1246-436b-979f-4485840aa9e5 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1736 microversion: 2.20 time: 0.401971 Feb 09 13:17:43.751129 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 438/857] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:43 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1736 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:17:44.209354 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-df4e7ca3-b3dc-4470-99af-299d8709c2ae tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:44.209992 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-df4e7ca3-b3dc-4470-99af-299d8709c2ae tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:44.217387 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-df4e7ca3-b3dc-4470-99af-299d8709c2ae tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:44.218084 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-df4e7ca3-b3dc-4470-99af-299d8709c2ae tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:44.219298 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-df4e7ca3-b3dc-4470-99af-299d8709c2ae tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:44.219755 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-df4e7ca3-b3dc-4470-99af-299d8709c2ae tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:44.381168 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-df4e7ca3-b3dc-4470-99af-299d8709c2ae tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:44.390176 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-df4e7ca3-b3dc-4470-99af-299d8709c2ae tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1265 microversion: 2.1 time: 0.184579 Feb 09 13:17:44.391875 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 420/858] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:44 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:17:44.768484 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-64a0e4d4-6d86-4ed5-9274-2d5d93464911 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:44.769099 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-64a0e4d4-6d86-4ed5-9274-2d5d93464911 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:44.775712 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-64a0e4d4-6d86-4ed5-9274-2d5d93464911 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:44.776272 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-64a0e4d4-6d86-4ed5-9274-2d5d93464911 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:44.777363 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-64a0e4d4-6d86-4ed5-9274-2d5d93464911 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:44.777803 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-64a0e4d4-6d86-4ed5-9274-2d5d93464911 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:44.917703 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-64a0e4d4-6d86-4ed5-9274-2d5d93464911 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:44.925590 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-64a0e4d4-6d86-4ed5-9274-2d5d93464911 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:44.927118 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-64a0e4d4-6d86-4ed5-9274-2d5d93464911 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:44.928257 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-64a0e4d4-6d86-4ed5-9274-2d5d93464911 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1736 microversion: 2.20 time: 0.163559 Feb 09 13:17:44.928809 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 439/859] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:44 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:17:44.960417 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-67dabcf1-700c-4115-bb58-1cd34e006072 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:44.960917 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-67dabcf1-700c-4115-bb58-1cd34e006072 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:44.967489 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-67dabcf1-700c-4115-bb58-1cd34e006072 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:44.968194 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-67dabcf1-700c-4115-bb58-1cd34e006072 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:44.969000 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-67dabcf1-700c-4115-bb58-1cd34e006072 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:44.969438 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-67dabcf1-700c-4115-bb58-1cd34e006072 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:44.983453 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-67dabcf1-700c-4115-bb58-1cd34e006072 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] HTTP exception thrown: Instance 7d2bee05-65c9-445a-a7ca-98808614d991 could not be found. Feb 09 13:17:44.984081 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-67dabcf1-700c-4115-bb58-1cd34e006072 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Returning 404 to user: Instance 7d2bee05-65c9-445a-a7ca-98808614d991 could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:17:44.984910 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-67dabcf1-700c-4115-bb58-1cd34e006072 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "DELETE /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 404 len: 111 microversion: 2.1 time: 0.028287 Feb 09 13:17:44.985452 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 421/860] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:17:44 2022] DELETE /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:17:44.993239 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-24091317-f762-4279-8633-9ac1d4fac372 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:44.993854 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-24091317-f762-4279-8633-9ac1d4fac372 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] [instance: 7d2bee05-65c9-445a-a7ca-98808614d991] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:45.000054 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-24091317-f762-4279-8633-9ac1d4fac372 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:45.000505 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-24091317-f762-4279-8633-9ac1d4fac372 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:45.001308 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-24091317-f762-4279-8633-9ac1d4fac372 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:45.001742 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-24091317-f762-4279-8633-9ac1d4fac372 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:45.016632 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.wsgi [None req-24091317-f762-4279-8633-9ac1d4fac372 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] HTTP exception thrown: Instance 7d2bee05-65c9-445a-a7ca-98808614d991 could not be found. Feb 09 13:17:45.016632 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-24091317-f762-4279-8633-9ac1d4fac372 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] Returning 404 to user: Instance 7d2bee05-65c9-445a-a7ca-98808614d991 could not be found. {{(pid=116748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:17:45.017787 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-24091317-f762-4279-8633-9ac1d4fac372 tempest-AttachVolumeTestJSON-525393116 tempest-AttachVolumeTestJSON-525393116-project] 10.222.0.84 "GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991" status: 404 len: 111 microversion: 2.1 time: 0.027619 Feb 09 13:17:45.017951 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 440/861] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:44 2022] GET /compute/v2.1/servers/7d2bee05-65c9-445a-a7ca-98808614d991 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:17:45.408200 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-0dd54a31-44a8-4410-91cf-e6c2f035f4d8 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:45.409651 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-0dd54a31-44a8-4410-91cf-e6c2f035f4d8 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:45.417296 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0dd54a31-44a8-4410-91cf-e6c2f035f4d8 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:45.417759 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0dd54a31-44a8-4410-91cf-e6c2f035f4d8 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:45.418809 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0dd54a31-44a8-4410-91cf-e6c2f035f4d8 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:45.419701 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0dd54a31-44a8-4410-91cf-e6c2f035f4d8 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:45.604019 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-0dd54a31-44a8-4410-91cf-e6c2f035f4d8 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:45.613290 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-0dd54a31-44a8-4410-91cf-e6c2f035f4d8 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1453 microversion: 2.1 time: 0.208728 Feb 09 13:17:45.619617 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 422/862] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:45 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1453 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:17:45.641740 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-cc826b63-c5ea-4f6f-9cc6-a16791b2731f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:45.642755 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-cc826b63-c5ea-4f6f-9cc6-a16791b2731f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:45.649476 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cc826b63-c5ea-4f6f-9cc6-a16791b2731f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:45.650154 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cc826b63-c5ea-4f6f-9cc6-a16791b2731f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:45.651216 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cc826b63-c5ea-4f6f-9cc6-a16791b2731f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:45.652662 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cc826b63-c5ea-4f6f-9cc6-a16791b2731f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:45.881185 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-cc826b63-c5ea-4f6f-9cc6-a16791b2731f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:45.890340 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-cc826b63-c5ea-4f6f-9cc6-a16791b2731f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1453 microversion: 2.1 time: 0.255610 Feb 09 13:17:45.896542 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 441/863] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:17:45 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1453 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:17:45.947253 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-1847d20f-56dd-40a8-a34b-27d7f1261a0e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:45.947865 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-1847d20f-56dd-40a8-a34b-27d7f1261a0e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:45.959076 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1847d20f-56dd-40a8-a34b-27d7f1261a0e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:45.959534 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1847d20f-56dd-40a8-a34b-27d7f1261a0e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:45.960339 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1847d20f-56dd-40a8-a34b-27d7f1261a0e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:45.960785 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1847d20f-56dd-40a8-a34b-27d7f1261a0e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:46.183215 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-1847d20f-56dd-40a8-a34b-27d7f1261a0e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:46.192931 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-1847d20f-56dd-40a8-a34b-27d7f1261a0e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:46.194661 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-1847d20f-56dd-40a8-a34b-27d7f1261a0e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:46.196054 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-1847d20f-56dd-40a8-a34b-27d7f1261a0e tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1736 microversion: 2.20 time: 0.252637 Feb 09 13:17:46.216072 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 423/864] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:45 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1736 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:17:47.218103 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-0af005a0-edb8-411f-afc0-b8c08926b9e1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:47.218978 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-0af005a0-edb8-411f-afc0-b8c08926b9e1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:47.228615 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0af005a0-edb8-411f-afc0-b8c08926b9e1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:47.229069 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0af005a0-edb8-411f-afc0-b8c08926b9e1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:47.229924 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0af005a0-edb8-411f-afc0-b8c08926b9e1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:47.230372 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0af005a0-edb8-411f-afc0-b8c08926b9e1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:47.702043 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-0af005a0-edb8-411f-afc0-b8c08926b9e1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:47.721267 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-0af005a0-edb8-411f-afc0-b8c08926b9e1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:47.722845 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-0af005a0-edb8-411f-afc0-b8c08926b9e1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:47.730339 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-0af005a0-edb8-411f-afc0-b8c08926b9e1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1736 microversion: 2.20 time: 0.514493 Feb 09 13:17:47.732738 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 442/865] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:47 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1736 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:17:48.760363 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-fda2ac9e-bfa2-4eb2-9982-86d7fa8e2913 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:48.760363 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-fda2ac9e-bfa2-4eb2-9982-86d7fa8e2913 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:48.760363 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-fda2ac9e-bfa2-4eb2-9982-86d7fa8e2913 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:48.760363 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-fda2ac9e-bfa2-4eb2-9982-86d7fa8e2913 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:48.762257 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-fda2ac9e-bfa2-4eb2-9982-86d7fa8e2913 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:48.762257 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-fda2ac9e-bfa2-4eb2-9982-86d7fa8e2913 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:48.987577 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-9b7df0bb-bc8f-493a-8c20-5b4b3ec261e2 req-2587a60a-b94b-4729-9a8a-43f9acf2846c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "794b82e0-8aad-46b1-9e9e-9cfb0d16abf5", "tag": "cde48d4a-b667-4fb2-8210-2d6efb90a93a"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:17:48.989675 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:17:48.989675 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:17:48.999145 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-9b7df0bb-bc8f-493a-8c20-5b4b3ec261e2 req-2587a60a-b94b-4729-9a8a-43f9acf2846c service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:48.999941 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-9b7df0bb-bc8f-493a-8c20-5b4b3ec261e2 req-2587a60a-b94b-4729-9a8a-43f9acf2846c service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:49.017429 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-9b7df0bb-bc8f-493a-8c20-5b4b3ec261e2 req-2587a60a-b94b-4729-9a8a-43f9acf2846c service nova] Creating event network-changed:cde48d4a-b667-4fb2-8210-2d6efb90a93a for instance 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 on hv-cinder-82786 Feb 09 13:17:49.023175 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-9b7df0bb-bc8f-493a-8c20-5b4b3ec261e2 req-2587a60a-b94b-4729-9a8a-43f9acf2846c service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039073 Feb 09 13:17:49.024364 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 443/866] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:17:49.194749 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-fda2ac9e-bfa2-4eb2-9982-86d7fa8e2913 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:49.219443 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-fda2ac9e-bfa2-4eb2-9982-86d7fa8e2913 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:49.221635 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-fda2ac9e-bfa2-4eb2-9982-86d7fa8e2913 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:49.223815 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-fda2ac9e-bfa2-4eb2-9982-86d7fa8e2913 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1736 microversion: 2.20 time: 0.478313 Feb 09 13:17:49.224698 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 424/867] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:48 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1736 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:17:50.244237 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-95e2a939-e6db-4373-b88b-93d4902881da tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:50.246658 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-95e2a939-e6db-4373-b88b-93d4902881da tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:50.253581 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-95e2a939-e6db-4373-b88b-93d4902881da tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:50.254229 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-95e2a939-e6db-4373-b88b-93d4902881da tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:50.255422 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-95e2a939-e6db-4373-b88b-93d4902881da tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:50.256025 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-95e2a939-e6db-4373-b88b-93d4902881da tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:50.443078 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-95e2a939-e6db-4373-b88b-93d4902881da tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:50.451436 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-95e2a939-e6db-4373-b88b-93d4902881da tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:50.452940 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-95e2a939-e6db-4373-b88b-93d4902881da tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:50.454088 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-95e2a939-e6db-4373-b88b-93d4902881da tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1736 microversion: 2.20 time: 0.214861 Feb 09 13:17:50.454701 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 444/868] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:50 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:17:51.471349 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-2c805dd4-a262-44b0-bd54-57bdd1931f06 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:51.472298 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-2c805dd4-a262-44b0-bd54-57bdd1931f06 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:51.479441 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2c805dd4-a262-44b0-bd54-57bdd1931f06 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:51.479897 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2c805dd4-a262-44b0-bd54-57bdd1931f06 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:51.480708 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2c805dd4-a262-44b0-bd54-57bdd1931f06 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:51.481148 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2c805dd4-a262-44b0-bd54-57bdd1931f06 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:51.723072 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-2c805dd4-a262-44b0-bd54-57bdd1931f06 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:51.731136 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-2c805dd4-a262-44b0-bd54-57bdd1931f06 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:51.732624 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-2c805dd4-a262-44b0-bd54-57bdd1931f06 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:51.733771 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-2c805dd4-a262-44b0-bd54-57bdd1931f06 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1718 microversion: 2.20 time: 0.266153 Feb 09 13:17:51.734670 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 425/869] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:51 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1718 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:17:52.752771 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-99e7cad7-aba1-436d-87b2-a89adc86c50d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:52.753852 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-99e7cad7-aba1-436d-87b2-a89adc86c50d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:52.760458 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-99e7cad7-aba1-436d-87b2-a89adc86c50d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:52.760950 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-99e7cad7-aba1-436d-87b2-a89adc86c50d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:52.761791 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-99e7cad7-aba1-436d-87b2-a89adc86c50d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:52.762238 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-99e7cad7-aba1-436d-87b2-a89adc86c50d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:52.906784 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-99e7cad7-aba1-436d-87b2-a89adc86c50d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:52.914472 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-99e7cad7-aba1-436d-87b2-a89adc86c50d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:52.916008 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-99e7cad7-aba1-436d-87b2-a89adc86c50d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:52.920461 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-99e7cad7-aba1-436d-87b2-a89adc86c50d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1718 microversion: 2.20 time: 0.168978 Feb 09 13:17:52.920461 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 445/870] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:52 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1718 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:17:53.937371 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ebe85f24-12c5-4fe2-b328-d95159bea15d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:53.937961 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-ebe85f24-12c5-4fe2-b328-d95159bea15d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:53.944458 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ebe85f24-12c5-4fe2-b328-d95159bea15d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:53.947013 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ebe85f24-12c5-4fe2-b328-d95159bea15d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:53.947013 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ebe85f24-12c5-4fe2-b328-d95159bea15d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:53.947013 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ebe85f24-12c5-4fe2-b328-d95159bea15d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:54.105704 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ebe85f24-12c5-4fe2-b328-d95159bea15d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:54.114341 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ebe85f24-12c5-4fe2-b328-d95159bea15d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:54.115921 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ebe85f24-12c5-4fe2-b328-d95159bea15d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:54.117121 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-ebe85f24-12c5-4fe2-b328-d95159bea15d tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1718 microversion: 2.20 time: 0.183625 Feb 09 13:17:54.117721 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 426/871] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:53 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1718 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:17:55.135420 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-72fba7c6-35d1-4f1b-9bbf-a6e2ddbd0eb1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:55.136049 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-72fba7c6-35d1-4f1b-9bbf-a6e2ddbd0eb1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:55.142533 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-72fba7c6-35d1-4f1b-9bbf-a6e2ddbd0eb1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:55.143016 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-72fba7c6-35d1-4f1b-9bbf-a6e2ddbd0eb1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:55.143812 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-72fba7c6-35d1-4f1b-9bbf-a6e2ddbd0eb1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:55.144254 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-72fba7c6-35d1-4f1b-9bbf-a6e2ddbd0eb1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:55.536563 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-72fba7c6-35d1-4f1b-9bbf-a6e2ddbd0eb1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:55.544696 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-72fba7c6-35d1-4f1b-9bbf-a6e2ddbd0eb1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:55.546191 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-72fba7c6-35d1-4f1b-9bbf-a6e2ddbd0eb1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:55.547381 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-72fba7c6-35d1-4f1b-9bbf-a6e2ddbd0eb1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1661 microversion: 2.20 time: 0.415779 Feb 09 13:17:55.548163 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 446/872] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:55 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1661 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:17:55.565094 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-7c872559-498b-4f45-83c5-b3db74376f28 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61434881-17d1-42d4-a621-5b94072f476f"}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:17:55.566336 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-7c872559-498b-4f45-83c5-b3db74376f28 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:55.572586 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7c872559-498b-4f45-83c5-b3db74376f28 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:55.573525 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7c872559-498b-4f45-83c5-b3db74376f28 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:55.574307 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7c872559-498b-4f45-83c5-b3db74376f28 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:55.574779 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7c872559-498b-4f45-83c5-b3db74376f28 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:56.058479 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 09 13:17:56.059144 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: Wed Feb 9 13:17:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 09 13:17:56.558260 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-7c872559-498b-4f45-83c5-b3db74376f28 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "POST /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.996214 Feb 09 13:17:56.559042 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 427/873] 10.222.0.84 () {62 vars in 1363 bytes} [Wed Feb 9 13:17:55 2022] POST /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00/os-volume_attachments => generated 188 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 09 13:17:56.680243 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-474ed5da-e0e8-4f91-b30c-73faecd36885 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:56.680799 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-474ed5da-e0e8-4f91-b30c-73faecd36885 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:56.687010 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-474ed5da-e0e8-4f91-b30c-73faecd36885 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:56.687459 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-474ed5da-e0e8-4f91-b30c-73faecd36885 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:56.688265 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-474ed5da-e0e8-4f91-b30c-73faecd36885 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:56.688713 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-474ed5da-e0e8-4f91-b30c-73faecd36885 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:56.700354 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-b25ff5c2-34d3-4562-bcf3-4abca46d3168 req-072fbbff-8053-477e-ae8f-3ef4dd8b23ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece0c49e-784a-49c1-85c1-de2a95a93e00", "name": "network-vif-unplugged", "status": "completed", "tag": "8fc972e9-0cc0-429d-a82a-fd959fe8f9d3"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:17:56.704873 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:17:56.704873 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:17:56.711366 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-b25ff5c2-34d3-4562-bcf3-4abca46d3168 req-072fbbff-8053-477e-ae8f-3ef4dd8b23ff service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:56.711807 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-b25ff5c2-34d3-4562-bcf3-4abca46d3168 req-072fbbff-8053-477e-ae8f-3ef4dd8b23ff service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:56.723178 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.compute.server_external_events [req-b25ff5c2-34d3-4562-bcf3-4abca46d3168 req-072fbbff-8053-477e-ae8f-3ef4dd8b23ff service nova] Unable to find a host for instance ece0c49e-784a-49c1-85c1-de2a95a93e00. Dropping event network-vif-unplugged {{(pid=116749) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 09 13:17:56.724057 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-b25ff5c2-34d3-4562-bcf3-4abca46d3168 req-072fbbff-8053-477e-ae8f-3ef4dd8b23ff service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028455 Feb 09 13:17:56.727808 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 428/874] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 09 13:17:57.269582 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-474ed5da-e0e8-4f91-b30c-73faecd36885 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "DELETE /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00/os-volume_attachments/61434881-17d1-42d4-a621-5b94072f476f" status: 202 len: 0 microversion: 2.20 time: 0.593236 Feb 09 13:17:57.270492 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 447/875] 10.222.0.84 () {60 vars in 1456 bytes} [Wed Feb 9 13:17:56 2022] DELETE /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00/os-volume_attachments/61434881-17d1-42d4-a621-5b94072f476f => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 09 13:17:57.328256 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-7ad08efd-89a2-4227-850e-81753a14a9b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:17:57.328969 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-7ad08efd-89a2-4227-850e-81753a14a9b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:57.335019 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7ad08efd-89a2-4227-850e-81753a14a9b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:57.335597 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7ad08efd-89a2-4227-850e-81753a14a9b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:57.336578 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7ad08efd-89a2-4227-850e-81753a14a9b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:57.337084 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-7ad08efd-89a2-4227-850e-81753a14a9b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:57.566439 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-7ad08efd-89a2-4227-850e-81753a14a9b2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "POST /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00/action" status: 202 len: 0 microversion: 2.20 time: 0.241792 Feb 09 13:17:57.567010 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 429/876] 10.222.0.84 () {62 vars in 1318 bytes} [Wed Feb 9 13:17:57 2022] POST /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 09 13:17:57.575771 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-370d1161-5a21-4686-b5a1-915f9103d13c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:57.576485 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-370d1161-5a21-4686-b5a1-915f9103d13c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:57.582795 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-370d1161-5a21-4686-b5a1-915f9103d13c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:57.583351 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-370d1161-5a21-4686-b5a1-915f9103d13c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:57.584226 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-370d1161-5a21-4686-b5a1-915f9103d13c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:57.584699 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-370d1161-5a21-4686-b5a1-915f9103d13c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:57.750454 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-370d1161-5a21-4686-b5a1-915f9103d13c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:57.756768 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-370d1161-5a21-4686-b5a1-915f9103d13c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:57.758257 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-370d1161-5a21-4686-b5a1-915f9103d13c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:57.759455 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-370d1161-5a21-4686-b5a1-915f9103d13c tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1669 microversion: 2.20 time: 0.188169 Feb 09 13:17:57.760014 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 448/877] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:57 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1669 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:17:58.780299 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-6b635b5a-79b1-4110-8390-7e9edc6ac92b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:58.780926 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-6b635b5a-79b1-4110-8390-7e9edc6ac92b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:58.790221 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6b635b5a-79b1-4110-8390-7e9edc6ac92b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:58.790770 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6b635b5a-79b1-4110-8390-7e9edc6ac92b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:58.791602 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6b635b5a-79b1-4110-8390-7e9edc6ac92b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:58.792244 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6b635b5a-79b1-4110-8390-7e9edc6ac92b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:58.929893 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6b635b5a-79b1-4110-8390-7e9edc6ac92b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:58.938211 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6b635b5a-79b1-4110-8390-7e9edc6ac92b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:58.939774 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6b635b5a-79b1-4110-8390-7e9edc6ac92b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:17:58.940910 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-6b635b5a-79b1-4110-8390-7e9edc6ac92b tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1671 microversion: 2.20 time: 0.166284 Feb 09 13:17:58.941469 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 430/878] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:58 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:17:59.960518 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-f3a83e5b-09de-475f-a071-2493adbbcee9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:17:59.961310 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-f3a83e5b-09de-475f-a071-2493adbbcee9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:17:59.968619 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f3a83e5b-09de-475f-a071-2493adbbcee9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:59.969151 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f3a83e5b-09de-475f-a071-2493adbbcee9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:17:59.969874 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f3a83e5b-09de-475f-a071-2493adbbcee9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:17:59.970314 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f3a83e5b-09de-475f-a071-2493adbbcee9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:00.133691 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f3a83e5b-09de-475f-a071-2493adbbcee9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:00.143789 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f3a83e5b-09de-475f-a071-2493adbbcee9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:00.145302 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f3a83e5b-09de-475f-a071-2493adbbcee9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:00.146488 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-f3a83e5b-09de-475f-a071-2493adbbcee9 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1727 microversion: 2.20 time: 0.190052 Feb 09 13:18:00.147078 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 449/879] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:17:59 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1727 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:18:01.171354 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-6efed8dc-0aa3-4b53-9ce2-81e8c44db3e7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:01.172079 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-6efed8dc-0aa3-4b53-9ce2-81e8c44db3e7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:01.183094 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6efed8dc-0aa3-4b53-9ce2-81e8c44db3e7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:01.184146 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6efed8dc-0aa3-4b53-9ce2-81e8c44db3e7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:01.186209 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6efed8dc-0aa3-4b53-9ce2-81e8c44db3e7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:01.187526 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6efed8dc-0aa3-4b53-9ce2-81e8c44db3e7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:01.377737 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6efed8dc-0aa3-4b53-9ce2-81e8c44db3e7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:01.390245 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6efed8dc-0aa3-4b53-9ce2-81e8c44db3e7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:01.391848 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6efed8dc-0aa3-4b53-9ce2-81e8c44db3e7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:01.392950 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-6efed8dc-0aa3-4b53-9ce2-81e8c44db3e7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1727 microversion: 2.20 time: 0.230273 Feb 09 13:18:01.393516 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 431/880] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:18:01 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1727 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:18:02.411648 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-ed3a13c2-5298-40ea-891b-b0d957b51ea1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:02.413096 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-ed3a13c2-5298-40ea-891b-b0d957b51ea1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:02.420987 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ed3a13c2-5298-40ea-891b-b0d957b51ea1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:02.421713 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ed3a13c2-5298-40ea-891b-b0d957b51ea1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:02.422877 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ed3a13c2-5298-40ea-891b-b0d957b51ea1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:02.423641 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ed3a13c2-5298-40ea-891b-b0d957b51ea1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:02.587833 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ed3a13c2-5298-40ea-891b-b0d957b51ea1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:02.597259 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ed3a13c2-5298-40ea-891b-b0d957b51ea1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:02.598999 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ed3a13c2-5298-40ea-891b-b0d957b51ea1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:02.600428 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-ed3a13c2-5298-40ea-891b-b0d957b51ea1 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1727 microversion: 2.20 time: 0.193011 Feb 09 13:18:02.601055 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 450/881] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:18:02 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1727 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:18:03.621990 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-bf7e836e-4bf1-4c7e-bbf3-1d091c6734f2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:03.623033 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-bf7e836e-4bf1-4c7e-bbf3-1d091c6734f2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:03.634316 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bf7e836e-4bf1-4c7e-bbf3-1d091c6734f2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:03.635276 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bf7e836e-4bf1-4c7e-bbf3-1d091c6734f2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:03.636040 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bf7e836e-4bf1-4c7e-bbf3-1d091c6734f2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:03.636476 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bf7e836e-4bf1-4c7e-bbf3-1d091c6734f2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:03.834881 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-bf7e836e-4bf1-4c7e-bbf3-1d091c6734f2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:03.844431 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-bf7e836e-4bf1-4c7e-bbf3-1d091c6734f2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:03.846936 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-bf7e836e-4bf1-4c7e-bbf3-1d091c6734f2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:03.847329 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-bf7e836e-4bf1-4c7e-bbf3-1d091c6734f2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1727 microversion: 2.20 time: 0.230233 Feb 09 13:18:03.858832 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 432/882] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:18:03 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1727 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:18:04.866118 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-6a6acf5c-52c8-4f1d-90eb-2cd56b21a389 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:04.866697 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-6a6acf5c-52c8-4f1d-90eb-2cd56b21a389 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:04.873879 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6a6acf5c-52c8-4f1d-90eb-2cd56b21a389 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:04.874376 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6a6acf5c-52c8-4f1d-90eb-2cd56b21a389 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:04.875214 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6a6acf5c-52c8-4f1d-90eb-2cd56b21a389 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:04.875661 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6a6acf5c-52c8-4f1d-90eb-2cd56b21a389 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:05.031500 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6a6acf5c-52c8-4f1d-90eb-2cd56b21a389 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:05.049787 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6a6acf5c-52c8-4f1d-90eb-2cd56b21a389 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:05.051585 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6a6acf5c-52c8-4f1d-90eb-2cd56b21a389 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:05.052992 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-6a6acf5c-52c8-4f1d-90eb-2cd56b21a389 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1727 microversion: 2.20 time: 0.190969 Feb 09 13:18:05.053628 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 451/883] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:18:04 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1727 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:18:06.076710 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-075bccb1-5076-4e2b-95b0-3c148ff59584 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:06.077466 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-075bccb1-5076-4e2b-95b0-3c148ff59584 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:06.084153 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-075bccb1-5076-4e2b-95b0-3c148ff59584 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:06.084963 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-075bccb1-5076-4e2b-95b0-3c148ff59584 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:06.086370 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-075bccb1-5076-4e2b-95b0-3c148ff59584 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:06.087059 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-075bccb1-5076-4e2b-95b0-3c148ff59584 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:06.278457 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-075bccb1-5076-4e2b-95b0-3c148ff59584 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:06.287482 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-075bccb1-5076-4e2b-95b0-3c148ff59584 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:06.289114 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-075bccb1-5076-4e2b-95b0-3c148ff59584 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:06.290296 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-075bccb1-5076-4e2b-95b0-3c148ff59584 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1727 microversion: 2.20 time: 0.222497 Feb 09 13:18:06.291016 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 433/884] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:18:06 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1727 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:18:07.312907 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-8fda545b-c8c8-4f1d-a654-9b3340f32297 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:07.314227 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-8fda545b-c8c8-4f1d-a654-9b3340f32297 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:07.320873 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8fda545b-c8c8-4f1d-a654-9b3340f32297 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:07.321352 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8fda545b-c8c8-4f1d-a654-9b3340f32297 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:07.322145 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8fda545b-c8c8-4f1d-a654-9b3340f32297 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:07.323366 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8fda545b-c8c8-4f1d-a654-9b3340f32297 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:07.509371 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-8fda545b-c8c8-4f1d-a654-9b3340f32297 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:07.524092 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-8fda545b-c8c8-4f1d-a654-9b3340f32297 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:07.525604 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-8fda545b-c8c8-4f1d-a654-9b3340f32297 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:07.527064 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-8fda545b-c8c8-4f1d-a654-9b3340f32297 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1727 microversion: 2.20 time: 0.218386 Feb 09 13:18:07.528181 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 452/885] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:18:07 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1727 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:18:08.557848 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d5d11f75-c83c-4cc7-be62-857f830b7d5a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:08.558932 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d5d11f75-c83c-4cc7-be62-857f830b7d5a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:08.569481 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d5d11f75-c83c-4cc7-be62-857f830b7d5a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:08.570223 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d5d11f75-c83c-4cc7-be62-857f830b7d5a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:08.571565 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d5d11f75-c83c-4cc7-be62-857f830b7d5a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:08.572327 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d5d11f75-c83c-4cc7-be62-857f830b7d5a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:08.726286 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-d5d11f75-c83c-4cc7-be62-857f830b7d5a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:08.735011 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-d5d11f75-c83c-4cc7-be62-857f830b7d5a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:08.736831 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-d5d11f75-c83c-4cc7-be62-857f830b7d5a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:08.737679 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d5d11f75-c83c-4cc7-be62-857f830b7d5a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1727 microversion: 2.20 time: 0.186491 Feb 09 13:18:08.738235 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 434/886] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:18:08 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:18:09.756998 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d30e71c8-323f-4340-a591-1be184d78bfd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:09.757625 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d30e71c8-323f-4340-a591-1be184d78bfd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:09.764338 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d30e71c8-323f-4340-a591-1be184d78bfd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:09.764791 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d30e71c8-323f-4340-a591-1be184d78bfd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:09.765569 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d30e71c8-323f-4340-a591-1be184d78bfd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:09.766010 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d30e71c8-323f-4340-a591-1be184d78bfd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:09.898232 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d30e71c8-323f-4340-a591-1be184d78bfd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:09.906866 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d30e71c8-323f-4340-a591-1be184d78bfd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:09.908377 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d30e71c8-323f-4340-a591-1be184d78bfd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:09.909540 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d30e71c8-323f-4340-a591-1be184d78bfd tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1727 microversion: 2.20 time: 0.156352 Feb 09 13:18:09.910108 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 453/887] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:18:09 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:18:10.927536 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-23ecac61-1a8b-4b55-a7d1-9c2aa1965674 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:10.928098 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-23ecac61-1a8b-4b55-a7d1-9c2aa1965674 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:10.934873 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-23ecac61-1a8b-4b55-a7d1-9c2aa1965674 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:10.935353 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-23ecac61-1a8b-4b55-a7d1-9c2aa1965674 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:10.936136 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-23ecac61-1a8b-4b55-a7d1-9c2aa1965674 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:10.936574 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-23ecac61-1a8b-4b55-a7d1-9c2aa1965674 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:11.071939 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-23ecac61-1a8b-4b55-a7d1-9c2aa1965674 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:11.080715 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-23ecac61-1a8b-4b55-a7d1-9c2aa1965674 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:11.082200 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-23ecac61-1a8b-4b55-a7d1-9c2aa1965674 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:11.083380 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-23ecac61-1a8b-4b55-a7d1-9c2aa1965674 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1727 microversion: 2.20 time: 0.159677 Feb 09 13:18:11.083932 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 435/888] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:18:10 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:18:12.101052 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-c25550ab-00f0-426c-8536-6f36e2e29036 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:12.101665 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-c25550ab-00f0-426c-8536-6f36e2e29036 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:12.108464 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c25550ab-00f0-426c-8536-6f36e2e29036 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:12.108918 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c25550ab-00f0-426c-8536-6f36e2e29036 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:12.109719 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c25550ab-00f0-426c-8536-6f36e2e29036 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:12.110171 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c25550ab-00f0-426c-8536-6f36e2e29036 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:12.259048 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-c25550ab-00f0-426c-8536-6f36e2e29036 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:12.274668 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-c25550ab-00f0-426c-8536-6f36e2e29036 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:12.276228 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-c25550ab-00f0-426c-8536-6f36e2e29036 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:12.277710 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-c25550ab-00f0-426c-8536-6f36e2e29036 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1727 microversion: 2.20 time: 0.180104 Feb 09 13:18:12.278463 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 454/889] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:18:12 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:18:13.295914 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-b5f337ff-5e0f-4466-898d-3d04d5df4b40 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:13.296598 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-b5f337ff-5e0f-4466-898d-3d04d5df4b40 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:13.302790 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b5f337ff-5e0f-4466-898d-3d04d5df4b40 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:13.303236 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b5f337ff-5e0f-4466-898d-3d04d5df4b40 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:13.304122 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b5f337ff-5e0f-4466-898d-3d04d5df4b40 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:13.304553 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b5f337ff-5e0f-4466-898d-3d04d5df4b40 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:13.444571 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-b5f337ff-5e0f-4466-898d-3d04d5df4b40 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:13.453216 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-b5f337ff-5e0f-4466-898d-3d04d5df4b40 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:13.454905 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-b5f337ff-5e0f-4466-898d-3d04d5df4b40 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:13.456121 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-b5f337ff-5e0f-4466-898d-3d04d5df4b40 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1727 microversion: 2.20 time: 0.163861 Feb 09 13:18:13.456620 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 436/890] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:18:13 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:18:14.473957 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-21ce858d-4058-44d6-bb71-7bca80c5bc29 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:14.474579 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-21ce858d-4058-44d6-bb71-7bca80c5bc29 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:14.481212 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-21ce858d-4058-44d6-bb71-7bca80c5bc29 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:14.481601 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-21ce858d-4058-44d6-bb71-7bca80c5bc29 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:14.482382 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-21ce858d-4058-44d6-bb71-7bca80c5bc29 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:14.482853 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-21ce858d-4058-44d6-bb71-7bca80c5bc29 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:14.624752 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-21ce858d-4058-44d6-bb71-7bca80c5bc29 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:14.634259 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-21ce858d-4058-44d6-bb71-7bca80c5bc29 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:14.636149 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-21ce858d-4058-44d6-bb71-7bca80c5bc29 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:14.638235 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-21ce858d-4058-44d6-bb71-7bca80c5bc29 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1727 microversion: 2.20 time: 0.168072 Feb 09 13:18:14.643145 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 455/891] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:18:14 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:18:14.791825 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-78950c16-3382-4441-a547-970095f99522 req-5dcf6c0c-6e4e-43fe-b816-fa68681a1f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece0c49e-784a-49c1-85c1-de2a95a93e00", "name": "network-vif-plugged", "status": "completed", "tag": "8fc972e9-0cc0-429d-a82a-fd959fe8f9d3"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:18:14.791825 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:18:14.791825 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:18:14.798142 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-78950c16-3382-4441-a547-970095f99522 req-5dcf6c0c-6e4e-43fe-b816-fa68681a1f09 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:14.798616 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-78950c16-3382-4441-a547-970095f99522 req-5dcf6c0c-6e4e-43fe-b816-fa68681a1f09 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:14.809637 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-78950c16-3382-4441-a547-970095f99522 req-5dcf6c0c-6e4e-43fe-b816-fa68681a1f09 service nova] Creating event network-vif-plugged:8fc972e9-0cc0-429d-a82a-fd959fe8f9d3 for instance ece0c49e-784a-49c1-85c1-de2a95a93e00 on hv-cinder-82786 Feb 09 13:18:14.815033 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-78950c16-3382-4441-a547-970095f99522 req-5dcf6c0c-6e4e-43fe-b816-fa68681a1f09 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029597 Feb 09 13:18:14.815626 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 437/892] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:18:15.657779 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-f42b144a-dc54-4b7c-a410-01ec0be1b9cb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:15.658397 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-f42b144a-dc54-4b7c-a410-01ec0be1b9cb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:15.664822 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f42b144a-dc54-4b7c-a410-01ec0be1b9cb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:15.665281 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f42b144a-dc54-4b7c-a410-01ec0be1b9cb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:15.666074 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f42b144a-dc54-4b7c-a410-01ec0be1b9cb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:15.667188 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f42b144a-dc54-4b7c-a410-01ec0be1b9cb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:15.800698 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f42b144a-dc54-4b7c-a410-01ec0be1b9cb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:15.809286 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f42b144a-dc54-4b7c-a410-01ec0be1b9cb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:15.814065 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f42b144a-dc54-4b7c-a410-01ec0be1b9cb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:15.814065 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-f42b144a-dc54-4b7c-a410-01ec0be1b9cb tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1727 microversion: 2.20 time: 0.157953 Feb 09 13:18:15.814065 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 456/893] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:18:15 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:18:16.831136 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-21bfe83a-ee31-477f-882f-86fb4d2b4b6a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:16.831819 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-21bfe83a-ee31-477f-882f-86fb4d2b4b6a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:16.838289 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-21bfe83a-ee31-477f-882f-86fb4d2b4b6a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:16.838664 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-21bfe83a-ee31-477f-882f-86fb4d2b4b6a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:16.840094 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-21bfe83a-ee31-477f-882f-86fb4d2b4b6a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:16.840524 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-21bfe83a-ee31-477f-882f-86fb4d2b4b6a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:16.982429 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-21bfe83a-ee31-477f-882f-86fb4d2b4b6a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:16.990340 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-21bfe83a-ee31-477f-882f-86fb4d2b4b6a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:16.992515 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-21bfe83a-ee31-477f-882f-86fb4d2b4b6a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:16.993262 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-21bfe83a-ee31-477f-882f-86fb4d2b4b6a tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1727 microversion: 2.20 time: 0.166657 Feb 09 13:18:16.993849 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 438/894] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:18:16 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:18:18.011911 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-2d9c234b-e9fb-4959-856c-9e2e51a14737 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:18.012576 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-2d9c234b-e9fb-4959-856c-9e2e51a14737 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:18.018878 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2d9c234b-e9fb-4959-856c-9e2e51a14737 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:18.019328 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2d9c234b-e9fb-4959-856c-9e2e51a14737 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:18.020103 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2d9c234b-e9fb-4959-856c-9e2e51a14737 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:18.020538 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2d9c234b-e9fb-4959-856c-9e2e51a14737 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:18.160039 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-2d9c234b-e9fb-4959-856c-9e2e51a14737 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:18.168309 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-2d9c234b-e9fb-4959-856c-9e2e51a14737 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:18.170037 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-2d9c234b-e9fb-4959-856c-9e2e51a14737 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:18.171226 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-2d9c234b-e9fb-4959-856c-9e2e51a14737 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1714 microversion: 2.20 time: 0.163214 Feb 09 13:18:18.172021 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 457/895] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:18:18 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1714 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:18:24.802334 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-17e6de9e-8a98-4240-88c7-1c77aab29b76 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1412139801", "imageRef": "af86cedd-e7d5-4a28-a810-f47830f4bffc", "flavorRef": "452", "networks": [{"uuid": "6fafe0f3-5d30-4182-9532-b8b1dd4db528"}]}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:18:24.852867 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.network.neutron [None req-17e6de9e-8a98-4240-88c7-1c77aab29b76 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] validate_networks() for [('6fafe0f3-5d30-4182-9532-b8b1dd4db528', None, None, None, None, None)] {{(pid=116749) validate_networks /opt/stack/nova/nova/network/neutron.py:2554}} Feb 09 13:18:25.220065 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-17e6de9e-8a98-4240-88c7-1c77aab29b76 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Flavor limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 09 13:18:25.220491 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-17e6de9e-8a98-4240-88c7-1c77aab29b76 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Image limits 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 09 13:18:25.221001 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-17e6de9e-8a98-4240-88c7-1c77aab29b76 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Flavor pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 09 13:18:25.221414 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-17e6de9e-8a98-4240-88c7-1c77aab29b76 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Image pref 0:0:0 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 09 13:18:25.221825 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.virt.hardware [None req-17e6de9e-8a98-4240-88c7-1c77aab29b76 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 09 13:18:25.230460 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-17e6de9e-8a98-4240-88c7-1c77aab29b76 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:25.231592 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-17e6de9e-8a98-4240-88c7-1c77aab29b76 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:25.232461 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-17e6de9e-8a98-4240-88c7-1c77aab29b76 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:25.232898 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-17e6de9e-8a98-4240-88c7-1c77aab29b76 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:25.249278 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-17e6de9e-8a98-4240-88c7-1c77aab29b76 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Getting quotas for project 6d127cc9afbd483ebeab270c62efa251. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:18:25.253102 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-17e6de9e-8a98-4240-88c7-1c77aab29b76 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Getting quotas for user 1cd19dc7d2494fe58118b14496455883 and project 6d127cc9afbd483ebeab270c62efa251. Resources: {'instances', 'cores', 'ram'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:18:25.264141 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-17e6de9e-8a98-4240-88c7-1c77aab29b76 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Going to run 1 instances... {{(pid=116749) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 09 13:18:25.266454 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-17e6de9e-8a98-4240-88c7-1c77aab29b76 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 42178215-9fb7-4685-970f-b29241775bf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af86cedd-e7d5-4a28-a810-f47830f4bffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 09 13:18:25.412373 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-17e6de9e-8a98-4240-88c7-1c77aab29b76 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613554 Feb 09 13:18:25.413033 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 439/896] 10.222.0.84 () {60 vars in 1146 bytes} [Wed Feb 9 13:18:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 09 13:18:25.423509 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-6aba1d50-55ee-4179-9ab6-167ff8011225 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:25.424202 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-6aba1d50-55ee-4179-9ab6-167ff8011225 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 42178215-9fb7-4685-970f-b29241775bf8] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:25.482515 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6aba1d50-55ee-4179-9ab6-167ff8011225 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:25.489347 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-6aba1d50-55ee-4179-9ab6-167ff8011225 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8" status: 200 len: 1219 microversion: 2.1 time: 0.070065 Feb 09 13:18:25.490431 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 458/897] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:18:25 2022] GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:18:26.506343 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-f1f6ad94-73a6-4478-8e3c-36f88dbd474c tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:26.506961 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-f1f6ad94-73a6-4478-8e3c-36f88dbd474c tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 42178215-9fb7-4685-970f-b29241775bf8] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:26.560667 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-f1f6ad94-73a6-4478-8e3c-36f88dbd474c tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:26.567227 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-f1f6ad94-73a6-4478-8e3c-36f88dbd474c tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8" status: 200 len: 1219 microversion: 2.1 time: 0.064640 Feb 09 13:18:26.567795 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 440/898] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:18:26 2022] GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:18:27.584188 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-9007ef82-a379-4fe9-9a12-fc7f6077f265 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:27.584809 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-9007ef82-a379-4fe9-9a12-fc7f6077f265 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 42178215-9fb7-4685-970f-b29241775bf8] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:27.591122 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9007ef82-a379-4fe9-9a12-fc7f6077f265 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:27.593483 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9007ef82-a379-4fe9-9a12-fc7f6077f265 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:27.593483 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9007ef82-a379-4fe9-9a12-fc7f6077f265 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:27.593483 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9007ef82-a379-4fe9-9a12-fc7f6077f265 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:27.660119 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-9007ef82-a379-4fe9-9a12-fc7f6077f265 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:27.663320 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-9007ef82-a379-4fe9-9a12-fc7f6077f265 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8" status: 200 len: 1271 microversion: 2.1 time: 0.083320 Feb 09 13:18:27.663883 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 459/899] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:18:27 2022] GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:18:28.680471 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-f08270ef-a5bb-46e8-b43d-417d9d86f0fa tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:28.681099 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-f08270ef-a5bb-46e8-b43d-417d9d86f0fa tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 42178215-9fb7-4685-970f-b29241775bf8] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:28.687500 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f08270ef-a5bb-46e8-b43d-417d9d86f0fa tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:28.693413 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f08270ef-a5bb-46e8-b43d-417d9d86f0fa tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:28.693413 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f08270ef-a5bb-46e8-b43d-417d9d86f0fa tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:28.693413 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f08270ef-a5bb-46e8-b43d-417d9d86f0fa tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:28.863985 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-f08270ef-a5bb-46e8-b43d-417d9d86f0fa tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:28.871194 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-f08270ef-a5bb-46e8-b43d-417d9d86f0fa tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8" status: 200 len: 1319 microversion: 2.1 time: 0.194551 Feb 09 13:18:28.872269 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 441/900] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:18:28 2022] GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:18:29.675339 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-68596ce6-f46d-4838-ab59-6dcdcbf34c39 req-1e4194e8-84b4-4d21-840d-1ab25d2e15e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42178215-9fb7-4685-970f-b29241775bf8", "tag": "912514c5-6a6f-413f-8293-ed22414868a1"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:18:29.676925 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:18:29.676925 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:18:29.684599 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-68596ce6-f46d-4838-ab59-6dcdcbf34c39 req-1e4194e8-84b4-4d21-840d-1ab25d2e15e1 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:29.688482 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-68596ce6-f46d-4838-ab59-6dcdcbf34c39 req-1e4194e8-84b4-4d21-840d-1ab25d2e15e1 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:29.696031 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-68596ce6-f46d-4838-ab59-6dcdcbf34c39 req-1e4194e8-84b4-4d21-840d-1ab25d2e15e1 service nova] Creating event network-changed:912514c5-6a6f-413f-8293-ed22414868a1 for instance 42178215-9fb7-4685-970f-b29241775bf8 on hv-cinder-82786 Feb 09 13:18:29.700821 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-68596ce6-f46d-4838-ab59-6dcdcbf34c39 req-1e4194e8-84b4-4d21-840d-1ab25d2e15e1 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029236 Feb 09 13:18:29.701424 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 460/901] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:18:29.888705 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c76f0b45-1a18-4341-ae47-835736ae1e97 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:29.889299 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-c76f0b45-1a18-4341-ae47-835736ae1e97 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 42178215-9fb7-4685-970f-b29241775bf8] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:29.895703 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c76f0b45-1a18-4341-ae47-835736ae1e97 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:29.896159 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c76f0b45-1a18-4341-ae47-835736ae1e97 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:29.896966 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c76f0b45-1a18-4341-ae47-835736ae1e97 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:29.897409 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c76f0b45-1a18-4341-ae47-835736ae1e97 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:30.282351 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c76f0b45-1a18-4341-ae47-835736ae1e97 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:30.289486 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c76f0b45-1a18-4341-ae47-835736ae1e97 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8" status: 200 len: 1319 microversion: 2.1 time: 0.404817 Feb 09 13:18:30.290059 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 442/902] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:18:29 2022] GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8 => generated 1319 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:18:31.307214 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-2666747b-7e40-4bb3-b466-c7350420be58 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:31.307919 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-2666747b-7e40-4bb3-b466-c7350420be58 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 42178215-9fb7-4685-970f-b29241775bf8] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:31.314096 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2666747b-7e40-4bb3-b466-c7350420be58 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:31.314543 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2666747b-7e40-4bb3-b466-c7350420be58 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:31.315351 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2666747b-7e40-4bb3-b466-c7350420be58 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:31.315787 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-2666747b-7e40-4bb3-b466-c7350420be58 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:31.452628 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-2666747b-7e40-4bb3-b466-c7350420be58 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:31.459944 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-2666747b-7e40-4bb3-b466-c7350420be58 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8" status: 200 len: 1319 microversion: 2.1 time: 0.157291 Feb 09 13:18:31.460514 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 461/903] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:18:31 2022] GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:18:32.476937 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-0b461eb5-7921-4851-84af-54e6bca5a5f4 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:32.477532 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-0b461eb5-7921-4851-84af-54e6bca5a5f4 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 42178215-9fb7-4685-970f-b29241775bf8] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:32.484378 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0b461eb5-7921-4851-84af-54e6bca5a5f4 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:32.484820 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0b461eb5-7921-4851-84af-54e6bca5a5f4 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:32.485592 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0b461eb5-7921-4851-84af-54e6bca5a5f4 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:32.486025 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0b461eb5-7921-4851-84af-54e6bca5a5f4 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:32.618057 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-0b461eb5-7921-4851-84af-54e6bca5a5f4 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:32.625280 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-0b461eb5-7921-4851-84af-54e6bca5a5f4 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8" status: 200 len: 1319 microversion: 2.1 time: 0.152025 Feb 09 13:18:32.626090 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 443/904] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:18:32 2022] GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:18:33.641692 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-fe6739c0-7b92-4adf-b227-c04c4a6428bc tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:33.642232 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-fe6739c0-7b92-4adf-b227-c04c4a6428bc tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 42178215-9fb7-4685-970f-b29241775bf8] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:33.648473 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fe6739c0-7b92-4adf-b227-c04c4a6428bc tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:33.648929 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fe6739c0-7b92-4adf-b227-c04c4a6428bc tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:33.649721 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fe6739c0-7b92-4adf-b227-c04c4a6428bc tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:33.650166 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fe6739c0-7b92-4adf-b227-c04c4a6428bc tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:33.785539 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-fe6739c0-7b92-4adf-b227-c04c4a6428bc tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:33.792753 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-fe6739c0-7b92-4adf-b227-c04c4a6428bc tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8" status: 200 len: 1319 microversion: 2.1 time: 0.154933 Feb 09 13:18:33.793302 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 462/905] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:18:33 2022] GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:18:34.809343 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8d7ff675-c524-41f8-8120-15a468e8e9ac tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:34.810592 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8d7ff675-c524-41f8-8120-15a468e8e9ac tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 42178215-9fb7-4685-970f-b29241775bf8] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:34.817261 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8d7ff675-c524-41f8-8120-15a468e8e9ac tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:34.817715 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8d7ff675-c524-41f8-8120-15a468e8e9ac tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:34.818523 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8d7ff675-c524-41f8-8120-15a468e8e9ac tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:34.818993 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8d7ff675-c524-41f8-8120-15a468e8e9ac tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:34.958868 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8d7ff675-c524-41f8-8120-15a468e8e9ac tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:34.962848 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8d7ff675-c524-41f8-8120-15a468e8e9ac tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8" status: 200 len: 1319 microversion: 2.1 time: 0.157296 Feb 09 13:18:34.963427 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 444/906] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:18:34 2022] GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:18:35.979543 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-78f4d15d-9887-4eba-a223-ee47b0044b3f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:35.980187 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-78f4d15d-9887-4eba-a223-ee47b0044b3f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 42178215-9fb7-4685-970f-b29241775bf8] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:35.987018 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-78f4d15d-9887-4eba-a223-ee47b0044b3f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:35.987467 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-78f4d15d-9887-4eba-a223-ee47b0044b3f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:35.988248 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-78f4d15d-9887-4eba-a223-ee47b0044b3f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:35.988685 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-78f4d15d-9887-4eba-a223-ee47b0044b3f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:36.118767 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-78f4d15d-9887-4eba-a223-ee47b0044b3f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:36.126519 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-78f4d15d-9887-4eba-a223-ee47b0044b3f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8" status: 200 len: 1319 microversion: 2.1 time: 0.150686 Feb 09 13:18:36.127117 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 463/907] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:18:35 2022] GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:18:36.936992 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-0e43fb13-2c93-449a-b57c-69af556d65c6 req-ba6b6304-cbc3-4743-9092-244e36dcf7cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42178215-9fb7-4685-970f-b29241775bf8", "name": "network-vif-plugged", "status": "completed", "tag": "912514c5-6a6f-413f-8293-ed22414868a1"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:18:36.938671 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:18:36.938671 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:18:36.945914 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-0e43fb13-2c93-449a-b57c-69af556d65c6 req-ba6b6304-cbc3-4743-9092-244e36dcf7cb service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:36.946353 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-0e43fb13-2c93-449a-b57c-69af556d65c6 req-ba6b6304-cbc3-4743-9092-244e36dcf7cb service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:36.961181 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-0e43fb13-2c93-449a-b57c-69af556d65c6 req-ba6b6304-cbc3-4743-9092-244e36dcf7cb service nova] Creating event network-vif-plugged:912514c5-6a6f-413f-8293-ed22414868a1 for instance 42178215-9fb7-4685-970f-b29241775bf8 on hv-cinder-82786 Feb 09 13:18:36.961674 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-0e43fb13-2c93-449a-b57c-69af556d65c6 req-ba6b6304-cbc3-4743-9092-244e36dcf7cb service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028991 Feb 09 13:18:36.962240 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 445/908] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:18:37.142750 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-194f942d-b2df-499f-aa3c-f1b431e559e2 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:37.143364 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-194f942d-b2df-499f-aa3c-f1b431e559e2 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 42178215-9fb7-4685-970f-b29241775bf8] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:37.149698 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-194f942d-b2df-499f-aa3c-f1b431e559e2 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:37.150154 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-194f942d-b2df-499f-aa3c-f1b431e559e2 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:37.150979 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-194f942d-b2df-499f-aa3c-f1b431e559e2 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:37.151428 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-194f942d-b2df-499f-aa3c-f1b431e559e2 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:37.288359 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-194f942d-b2df-499f-aa3c-f1b431e559e2 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:37.296212 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-194f942d-b2df-499f-aa3c-f1b431e559e2 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8" status: 200 len: 1319 microversion: 2.1 time: 0.157252 Feb 09 13:18:37.296797 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 464/909] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:18:37 2022] GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:18:38.314656 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-9f496f95-b10c-438d-a384-cc34219468af tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:38.315375 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-9f496f95-b10c-438d-a384-cc34219468af tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 42178215-9fb7-4685-970f-b29241775bf8] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:38.321422 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9f496f95-b10c-438d-a384-cc34219468af tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:38.321875 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9f496f95-b10c-438d-a384-cc34219468af tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:38.322697 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9f496f95-b10c-438d-a384-cc34219468af tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:38.323141 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-9f496f95-b10c-438d-a384-cc34219468af tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:38.461456 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-9f496f95-b10c-438d-a384-cc34219468af tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:38.468844 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-9f496f95-b10c-438d-a384-cc34219468af tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8" status: 200 len: 1319 microversion: 2.1 time: 0.159242 Feb 09 13:18:38.469460 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 446/910] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:18:38 2022] GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:18:39.485118 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-36854c34-f563-410f-890e-97ea20443618 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:39.485739 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-36854c34-f563-410f-890e-97ea20443618 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 42178215-9fb7-4685-970f-b29241775bf8] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:39.492025 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-36854c34-f563-410f-890e-97ea20443618 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:39.492474 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-36854c34-f563-410f-890e-97ea20443618 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:39.493262 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-36854c34-f563-410f-890e-97ea20443618 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:39.493699 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-36854c34-f563-410f-890e-97ea20443618 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:39.639011 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-36854c34-f563-410f-890e-97ea20443618 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:39.646357 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-36854c34-f563-410f-890e-97ea20443618 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8" status: 200 len: 1507 microversion: 2.1 time: 0.165046 Feb 09 13:18:39.646953 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 465/911] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:18:39 2022] GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:18:52.340515 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-496b9747-d88b-4f49-b332-3736383b4191 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:52.341535 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-496b9747-d88b-4f49-b332-3736383b4191 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:52.348611 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-496b9747-d88b-4f49-b332-3736383b4191 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:52.349062 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-496b9747-d88b-4f49-b332-3736383b4191 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:52.349849 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-496b9747-d88b-4f49-b332-3736383b4191 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:52.350294 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-496b9747-d88b-4f49-b332-3736383b4191 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:52.377759 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-496b9747-d88b-4f49-b332-3736383b4191 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041187 Feb 09 13:18:52.378315 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 447/912] 10.222.0.84 () {60 vars in 1342 bytes} [Wed Feb 9 13:18:52 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:18:52.435557 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-1de3c749-003e-4646-9be2-f88aaf7d9def tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:52.436114 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-1de3c749-003e-4646-9be2-f88aaf7d9def tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:52.442444 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1de3c749-003e-4646-9be2-f88aaf7d9def tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:52.442927 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1de3c749-003e-4646-9be2-f88aaf7d9def tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:52.443725 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1de3c749-003e-4646-9be2-f88aaf7d9def tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:52.444168 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1de3c749-003e-4646-9be2-f88aaf7d9def tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:52.470749 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-1de3c749-003e-4646-9be2-f88aaf7d9def tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Going to try to terminate instance {{(pid=116748) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 09 13:18:52.786674 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-1de3c749-003e-4646-9be2-f88aaf7d9def tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "DELETE /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 204 len: 0 microversion: 2.20 time: 0.354503 Feb 09 13:18:52.787266 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 466/913] 10.222.0.84 () {60 vars in 1279 bytes} [Wed Feb 9 13:18:52 2022] DELETE /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 09 13:18:52.795105 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8905e44c-b8dd-4154-a18c-bf50b660ccbf tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:52.796386 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8905e44c-b8dd-4154-a18c-bf50b660ccbf tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:52.802124 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8905e44c-b8dd-4154-a18c-bf50b660ccbf tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:52.802592 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8905e44c-b8dd-4154-a18c-bf50b660ccbf tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:52.803377 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8905e44c-b8dd-4154-a18c-bf50b660ccbf tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:52.803860 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8905e44c-b8dd-4154-a18c-bf50b660ccbf tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:52.935942 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8905e44c-b8dd-4154-a18c-bf50b660ccbf tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:52.943998 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8905e44c-b8dd-4154-a18c-bf50b660ccbf tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:52.945494 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8905e44c-b8dd-4154-a18c-bf50b660ccbf tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:52.946673 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8905e44c-b8dd-4154-a18c-bf50b660ccbf tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1720 microversion: 2.20 time: 0.155164 Feb 09 13:18:52.947246 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 448/914] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:18:52 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:18:53.965120 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d4d6bb45-b5aa-49f6-a98f-f2fcaae95a81 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:53.965904 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d4d6bb45-b5aa-49f6-a98f-f2fcaae95a81 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:53.972147 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d4d6bb45-b5aa-49f6-a98f-f2fcaae95a81 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:53.972602 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d4d6bb45-b5aa-49f6-a98f-f2fcaae95a81 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:53.973594 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d4d6bb45-b5aa-49f6-a98f-f2fcaae95a81 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:53.973854 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d4d6bb45-b5aa-49f6-a98f-f2fcaae95a81 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:54.105283 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d4d6bb45-b5aa-49f6-a98f-f2fcaae95a81 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:54.113702 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d4d6bb45-b5aa-49f6-a98f-f2fcaae95a81 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:54.115313 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d4d6bb45-b5aa-49f6-a98f-f2fcaae95a81 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:54.116472 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d4d6bb45-b5aa-49f6-a98f-f2fcaae95a81 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1720 microversion: 2.20 time: 0.155487 Feb 09 13:18:54.117033 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 467/915] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:18:53 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 09 13:18:55.134646 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-5d49bb25-7af4-46ce-8260-0349375acaf2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:55.135427 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-5d49bb25-7af4-46ce-8260-0349375acaf2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:55.142478 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5d49bb25-7af4-46ce-8260-0349375acaf2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:55.143007 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5d49bb25-7af4-46ce-8260-0349375acaf2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:55.144436 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5d49bb25-7af4-46ce-8260-0349375acaf2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:55.144987 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5d49bb25-7af4-46ce-8260-0349375acaf2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:55.214823 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-5d49bb25-7af4-46ce-8260-0349375acaf2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:55.222671 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-5d49bb25-7af4-46ce-8260-0349375acaf2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:55.225521 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-5d49bb25-7af4-46ce-8260-0349375acaf2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:55.225521 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-5d49bb25-7af4-46ce-8260-0349375acaf2 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1652 microversion: 2.20 time: 0.094737 Feb 09 13:18:55.225907 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 449/916] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:18:55 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1652 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:18:55.400295 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-d52cf874-d914-402a-bcb7-6200f5565715 req-629602f4-121f-4584-b522-38131877f393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece0c49e-784a-49c1-85c1-de2a95a93e00", "name": "network-vif-deleted", "tag": "8fc972e9-0cc0-429d-a82a-fd959fe8f9d3"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:18:55.402176 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:18:55.402176 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:18:55.411090 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-d52cf874-d914-402a-bcb7-6200f5565715 req-629602f4-121f-4584-b522-38131877f393 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:55.411637 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-d52cf874-d914-402a-bcb7-6200f5565715 req-629602f4-121f-4584-b522-38131877f393 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:55.423748 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-d52cf874-d914-402a-bcb7-6200f5565715 req-629602f4-121f-4584-b522-38131877f393 service nova] Creating event network-vif-deleted:8fc972e9-0cc0-429d-a82a-fd959fe8f9d3 for instance ece0c49e-784a-49c1-85c1-de2a95a93e00 on hv-cinder-82786 Feb 09 13:18:55.429745 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-d52cf874-d914-402a-bcb7-6200f5565715 req-629602f4-121f-4584-b522-38131877f393 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033956 Feb 09 13:18:55.431006 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 468/917] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:18:56.088172 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-f3683e27-de6d-4b98-bf77-984c63610c31 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f9542fb-8619-4a11-b86f-781ef6b91e70", "device": "/dev/sdb"}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:18:56.090137 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-f3683e27-de6d-4b98-bf77-984c63610c31 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 42178215-9fb7-4685-970f-b29241775bf8] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:56.097077 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f3683e27-de6d-4b98-bf77-984c63610c31 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:56.097490 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f3683e27-de6d-4b98-bf77-984c63610c31 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:56.098301 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f3683e27-de6d-4b98-bf77-984c63610c31 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:56.098775 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-f3683e27-de6d-4b98-bf77-984c63610c31 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:56.243111 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-3eae4b2d-58af-4b02-a745-d38a00079298 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:56.243835 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-3eae4b2d-58af-4b02-a745-d38a00079298 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:56.250179 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3eae4b2d-58af-4b02-a745-d38a00079298 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:56.250663 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3eae4b2d-58af-4b02-a745-d38a00079298 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:56.251460 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3eae4b2d-58af-4b02-a745-d38a00079298 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:56.251898 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3eae4b2d-58af-4b02-a745-d38a00079298 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:56.286204 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3eae4b2d-58af-4b02-a745-d38a00079298 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:56.286692 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3eae4b2d-58af-4b02-a745-d38a00079298 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:56.291109 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-3eae4b2d-58af-4b02-a745-d38a00079298 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lazy-loading 'fault' on Instance uuid ece0c49e-784a-49c1-85c1-de2a95a93e00 {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:18:56.335534 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-3eae4b2d-58af-4b02-a745-d38a00079298 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:56.344155 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-3eae4b2d-58af-4b02-a745-d38a00079298 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:56.345702 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-3eae4b2d-58af-4b02-a745-d38a00079298 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58dc0b9f64334ecb9a325e6511786a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4edb9e42144956ae9a0a0f8c99bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:18:56.347528 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-3eae4b2d-58af-4b02-a745-d38a00079298 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 200 len: 1369 microversion: 2.20 time: 0.108089 Feb 09 13:18:56.348111 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 469/918] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:18:56 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 09 13:18:56.921421 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-f3683e27-de6d-4b98-bf77-984c63610c31 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "POST /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.837034 Feb 09 13:18:56.922204 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 450/919] 10.222.0.84 () {60 vars in 1322 bytes} [Wed Feb 9 13:18:56 2022] POST /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8/os-volume_attachments => generated 194 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:18:57.368464 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-7229bdf7-baa1-4e5c-80a5-c6a514ba6b31 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:57.369032 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-7229bdf7-baa1-4e5c-80a5-c6a514ba6b31 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:57.375354 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7229bdf7-baa1-4e5c-80a5-c6a514ba6b31 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:57.375856 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7229bdf7-baa1-4e5c-80a5-c6a514ba6b31 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:57.376638 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7229bdf7-baa1-4e5c-80a5-c6a514ba6b31 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:57.377139 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-7229bdf7-baa1-4e5c-80a5-c6a514ba6b31 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:57.390092 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.wsgi [None req-7229bdf7-baa1-4e5c-80a5-c6a514ba6b31 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] HTTP exception thrown: Instance ece0c49e-784a-49c1-85c1-de2a95a93e00 could not be found. Feb 09 13:18:57.390724 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-7229bdf7-baa1-4e5c-80a5-c6a514ba6b31 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Returning 404 to user: Instance ece0c49e-784a-49c1-85c1-de2a95a93e00 could not be found. {{(pid=116748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:18:57.391540 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-7229bdf7-baa1-4e5c-80a5-c6a514ba6b31 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 404 len: 111 microversion: 2.20 time: 0.027090 Feb 09 13:18:57.392070 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 470/920] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:18:57 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 09 13:18:57.401191 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-15631cdc-17a0-4dba-8297-7e46065386f7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '.version_select at 0x7f7f6465b040>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:57.544659 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-15631cdc-17a0-4dba-8297-7e46065386f7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-60412431" status: 204 len: 0 microversion: 2.20 time: 0.147677 Feb 09 13:18:57.545112 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 451/921] 10.222.0.84 () {60 vars in 1255 bytes} [Wed Feb 9 13:18:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-60412431 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 09 13:18:59.575383 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-c2c8cbc6-6b76-477d-977a-3fd9042e16d6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:59.575915 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-c2c8cbc6-6b76-477d-977a-3fd9042e16d6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:59.582352 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c2c8cbc6-6b76-477d-977a-3fd9042e16d6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:59.585789 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c2c8cbc6-6b76-477d-977a-3fd9042e16d6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:59.585789 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c2c8cbc6-6b76-477d-977a-3fd9042e16d6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:59.585789 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c2c8cbc6-6b76-477d-977a-3fd9042e16d6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:59.598300 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.wsgi [None req-c2c8cbc6-6b76-477d-977a-3fd9042e16d6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] HTTP exception thrown: Instance ece0c49e-784a-49c1-85c1-de2a95a93e00 could not be found. Feb 09 13:18:59.598937 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-c2c8cbc6-6b76-477d-977a-3fd9042e16d6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Returning 404 to user: Instance ece0c49e-784a-49c1-85c1-de2a95a93e00 could not be found. {{(pid=116748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:18:59.599770 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-c2c8cbc6-6b76-477d-977a-3fd9042e16d6 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "DELETE /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 404 len: 111 microversion: 2.20 time: 0.028277 Feb 09 13:18:59.600329 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 471/922] 10.222.0.84 () {60 vars in 1279 bytes} [Wed Feb 9 13:18:59 2022] DELETE /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 09 13:18:59.609690 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-2e621601-9955-4e8d-b5fc-9896e14ed443 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:18:59.611065 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-2e621601-9955-4e8d-b5fc-9896e14ed443 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: ece0c49e-784a-49c1-85c1-de2a95a93e00] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:18:59.618205 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2e621601-9955-4e8d-b5fc-9896e14ed443 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:59.618942 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2e621601-9955-4e8d-b5fc-9896e14ed443 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:59.619754 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2e621601-9955-4e8d-b5fc-9896e14ed443 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:18:59.620200 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2e621601-9955-4e8d-b5fc-9896e14ed443 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:18:59.639240 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-2e621601-9955-4e8d-b5fc-9896e14ed443 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] HTTP exception thrown: Instance ece0c49e-784a-49c1-85c1-de2a95a93e00 could not be found. Feb 09 13:18:59.639916 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-2e621601-9955-4e8d-b5fc-9896e14ed443 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Returning 404 to user: Instance ece0c49e-784a-49c1-85c1-de2a95a93e00 could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:18:59.640729 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-2e621601-9955-4e8d-b5fc-9896e14ed443 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00" status: 404 len: 111 microversion: 2.20 time: 0.035390 Feb 09 13:18:59.641299 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 452/923] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:18:59 2022] GET /compute/v2.1/servers/ece0c49e-784a-49c1-85c1-de2a95a93e00 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 09 13:19:00.925655 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-cdf45f63-4a80-4b0c-8e4e-0ea2d6f084b7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:00.926178 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-cdf45f63-4a80-4b0c-8e4e-0ea2d6f084b7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:00.932428 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cdf45f63-4a80-4b0c-8e4e-0ea2d6f084b7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:00.932884 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cdf45f63-4a80-4b0c-8e4e-0ea2d6f084b7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:00.933673 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cdf45f63-4a80-4b0c-8e4e-0ea2d6f084b7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:00.934116 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-cdf45f63-4a80-4b0c-8e4e-0ea2d6f084b7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:00.947525 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.wsgi [None req-cdf45f63-4a80-4b0c-8e4e-0ea2d6f084b7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] HTTP exception thrown: Instance 267a95df-7ddb-4e9c-a629-4fc26b9c9843 could not be found. Feb 09 13:19:00.948140 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-cdf45f63-4a80-4b0c-8e4e-0ea2d6f084b7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Returning 404 to user: Instance 267a95df-7ddb-4e9c-a629-4fc26b9c9843 could not be found. {{(pid=116748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:19:00.948951 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-cdf45f63-4a80-4b0c-8e4e-0ea2d6f084b7 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "DELETE /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 404 len: 111 microversion: 2.20 time: 0.027698 Feb 09 13:19:00.949474 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 472/924] 10.222.0.84 () {60 vars in 1279 bytes} [Wed Feb 9 13:19:00 2022] DELETE /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 09 13:19:00.957136 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-3253f5d8-f0b6-44be-93fb-89969ac0c954 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:00.957738 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-3253f5d8-f0b6-44be-93fb-89969ac0c954 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] [instance: 267a95df-7ddb-4e9c-a629-4fc26b9c9843] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:00.963959 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3253f5d8-f0b6-44be-93fb-89969ac0c954 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:00.964411 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3253f5d8-f0b6-44be-93fb-89969ac0c954 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:00.965183 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3253f5d8-f0b6-44be-93fb-89969ac0c954 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:00.965640 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3253f5d8-f0b6-44be-93fb-89969ac0c954 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:00.978826 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-3253f5d8-f0b6-44be-93fb-89969ac0c954 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] HTTP exception thrown: Instance 267a95df-7ddb-4e9c-a629-4fc26b9c9843 could not be found. Feb 09 13:19:00.979334 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-3253f5d8-f0b6-44be-93fb-89969ac0c954 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] Returning 404 to user: Instance 267a95df-7ddb-4e9c-a629-4fc26b9c9843 could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:19:00.980128 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-3253f5d8-f0b6-44be-93fb-89969ac0c954 tempest-AttachVolumeShelveTestJSON-629908746 tempest-AttachVolumeShelveTestJSON-629908746-project] 10.222.0.84 "GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843" status: 404 len: 111 microversion: 2.20 time: 0.026692 Feb 09 13:19:00.980636 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 453/925] 10.222.0.84 () {60 vars in 1276 bytes} [Wed Feb 9 13:19:00 2022] GET /compute/v2.1/servers/267a95df-7ddb-4e9c-a629-4fc26b9c9843 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 09 13:19:06.564553 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-1d423932-2265-4ea4-8b42-140901bb2a83 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Action: 'create', calling method: .version_select at 0x7f7f6463fd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1547228158"}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:19:07.239969 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-1d423932-2265-4ea4-8b42-140901bb2a83 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.792330 Feb 09 13:19:07.240631 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 473/926] 10.222.0.84 () {60 vars in 1154 bytes} [Wed Feb 9 13:19:06 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 794 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 09 13:19:07.251450 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-21511111-c763-42f9-b1d4-ba3aa1e363e9 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Calling method '.version_select at 0x7f7f646654c0>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:07.301015 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-21511111-c763-42f9-b1d4-ba3aa1e363e9 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/894cb762-da19-4fe7-bbb4-d4afd0f55251" status: 200 len: 345 microversion: 2.1 time: 0.053265 Feb 09 13:19:07.301730 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 454/927] 10.222.0.84 () {58 vars in 1244 bytes} [Wed Feb 9 13:19:07 2022] GET /compute/v2.1/os-volumes/894cb762-da19-4fe7-bbb4-d4afd0f55251 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:19:08.313776 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-7ff12fc6-5ab2-42eb-8aba-e6c69bd234fe tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Calling method '.version_select at 0x7f7f6467d700>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:08.361195 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-7ff12fc6-5ab2-42eb-8aba-e6c69bd234fe tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/894cb762-da19-4fe7-bbb4-d4afd0f55251" status: 200 len: 346 microversion: 2.1 time: 0.051591 Feb 09 13:19:08.361757 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 474/928] 10.222.0.84 () {58 vars in 1244 bytes} [Wed Feb 9 13:19:08 2022] GET /compute/v2.1/os-volumes/894cb762-da19-4fe7-bbb4-d4afd0f55251 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:19:08.374965 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-7cdf2cf0-3342-4f3c-86d9-e69853f7c683 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Action: 'create', calling method: .version_select at 0x7f7f64670310>, body: {"snapshot": {"volume_id": "894cb762-da19-4fe7-bbb4-d4afd0f55251", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1525317625"}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:19:08.794587 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-7cdf2cf0-3342-4f3c-86d9-e69853f7c683 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.423689 Feb 09 13:19:08.795518 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 455/929] 10.222.0.84 () {60 vars in 1161 bytes} [Wed Feb 9 13:19:08 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:19:08.805709 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-6859caca-f06b-4050-9897-38a0b55d3b8e tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Calling method '.version_select at 0x7f7f6459a310>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:08.835197 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-6859caca-f06b-4050-9897-38a0b55d3b8e tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/99087a1c-f856-48ab-8447-60c985794219" status: 200 len: 287 microversion: 2.1 time: 0.033116 Feb 09 13:19:08.835763 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 475/930] 10.222.0.84 () {58 vars in 1250 bytes} [Wed Feb 9 13:19:08 2022] GET /compute/v2.1/os-snapshots/99087a1c-f856-48ab-8447-60c985794219 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:19:08.845472 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c5ad07bd-ebd5-4cd7-9f71-c5db4df331f1 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Calling method '.version_select at 0x7f7f64670280>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:08.874812 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c5ad07bd-ebd5-4cd7-9f71-c5db4df331f1 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.032994 Feb 09 13:19:08.875374 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 456/931] 10.222.0.84 () {58 vars in 1139 bytes} [Wed Feb 9 13:19:08 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:19:08.887032 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-84f66002-bba7-4502-8862-c8af1ef77c87 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Calling method '.version_select at 0x7f7f64697ee0>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:08.917280 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-84f66002-bba7-4502-8862-c8af1ef77c87 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/99087a1c-f856-48ab-8447-60c985794219" status: 200 len: 287 microversion: 2.1 time: 0.035027 Feb 09 13:19:08.917848 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 476/932] 10.222.0.84 () {58 vars in 1250 bytes} [Wed Feb 9 13:19:08 2022] GET /compute/v2.1/os-snapshots/99087a1c-f856-48ab-8447-60c985794219 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:19:09.929584 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ee4b9e4b-2e9d-416e-b58f-08997574a8a0 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Calling method '.version_select at 0x7f7f6463caf0>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:09.960064 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-ee4b9e4b-2e9d-416e-b58f-08997574a8a0 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/99087a1c-f856-48ab-8447-60c985794219" status: 200 len: 287 microversion: 2.1 time: 0.034698 Feb 09 13:19:09.960625 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 457/933] 10.222.0.84 () {58 vars in 1250 bytes} [Wed Feb 9 13:19:09 2022] GET /compute/v2.1/os-snapshots/99087a1c-f856-48ab-8447-60c985794219 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:19:10.972606 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-b9a853c1-b00d-42c7-9d33-792c36d8a429 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Calling method '.version_select at 0x7f7f647cf5e0>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:11.001706 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-b9a853c1-b00d-42c7-9d33-792c36d8a429 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/99087a1c-f856-48ab-8447-60c985794219" status: 200 len: 287 microversion: 2.1 time: 0.033681 Feb 09 13:19:11.002260 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 477/934] 10.222.0.84 () {58 vars in 1250 bytes} [Wed Feb 9 13:19:10 2022] GET /compute/v2.1/os-snapshots/99087a1c-f856-48ab-8447-60c985794219 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:19:12.013795 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-69a85d16-209b-4c07-ad60-6d9947fee66c tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Calling method '.version_select at 0x7f7f6468bd30>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:12.044147 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-69a85d16-209b-4c07-ad60-6d9947fee66c tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/99087a1c-f856-48ab-8447-60c985794219" status: 200 len: 287 microversion: 2.1 time: 0.034477 Feb 09 13:19:12.044701 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 458/935] 10.222.0.84 () {58 vars in 1250 bytes} [Wed Feb 9 13:19:12 2022] GET /compute/v2.1/os-snapshots/99087a1c-f856-48ab-8447-60c985794219 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:19:13.056360 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-367082cd-1d6d-4bbc-bc68-1d1772537744 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Calling method '.version_select at 0x7f7f646974c0>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:13.085275 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-367082cd-1d6d-4bbc-bc68-1d1772537744 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/99087a1c-f856-48ab-8447-60c985794219" status: 200 len: 288 microversion: 2.1 time: 0.033036 Feb 09 13:19:13.085836 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 478/936] 10.222.0.84 () {58 vars in 1250 bytes} [Wed Feb 9 13:19:13 2022] GET /compute/v2.1/os-snapshots/99087a1c-f856-48ab-8447-60c985794219 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:19:13.102130 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-496ad4cb-383b-4a46-9a6c-795afc508ee0 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Calling method '.version_select at 0x7f7f6469d4c0>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:13.247015 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-496ad4cb-383b-4a46-9a6c-795afc508ee0 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "DELETE /compute/v2.1/os-snapshots/99087a1c-f856-48ab-8447-60c985794219" status: 202 len: 0 microversion: 2.1 time: 0.148710 Feb 09 13:19:13.247599 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 459/937] 10.222.0.84 () {58 vars in 1253 bytes} [Wed Feb 9 13:19:13 2022] DELETE /compute/v2.1/os-snapshots/99087a1c-f856-48ab-8447-60c985794219 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:19:13.256318 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-8cba3912-51fe-417f-8182-4aba5940d7ea tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Calling method '.version_select at 0x7f7f6465adc0>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:13.284978 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-8cba3912-51fe-417f-8182-4aba5940d7ea tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/99087a1c-f856-48ab-8447-60c985794219" status: 200 len: 287 microversion: 2.1 time: 0.032853 Feb 09 13:19:13.285548 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 479/938] 10.222.0.84 () {58 vars in 1250 bytes} [Wed Feb 9 13:19:13 2022] GET /compute/v2.1/os-snapshots/99087a1c-f856-48ab-8447-60c985794219 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:19:14.296837 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-185e3dc0-16cb-4a65-a0e1-aa9861da1b9b tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Calling method '.version_select at 0x7f7f64665310>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:14.325355 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-185e3dc0-16cb-4a65-a0e1-aa9861da1b9b tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/99087a1c-f856-48ab-8447-60c985794219" status: 200 len: 287 microversion: 2.1 time: 0.032519 Feb 09 13:19:14.325907 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 460/939] 10.222.0.84 () {58 vars in 1250 bytes} [Wed Feb 9 13:19:14 2022] GET /compute/v2.1/os-snapshots/99087a1c-f856-48ab-8447-60c985794219 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:19:15.337001 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-3cb296ea-1696-480d-9ef8-96c5fc69ddf5 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Calling method '.version_select at 0x7f7f64835ca0>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:15.369137 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-3cb296ea-1696-480d-9ef8-96c5fc69ddf5 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/99087a1c-f856-48ab-8447-60c985794219" status: 200 len: 287 microversion: 2.1 time: 0.036124 Feb 09 13:19:15.369979 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 480/940] 10.222.0.84 () {58 vars in 1250 bytes} [Wed Feb 9 13:19:15 2022] GET /compute/v2.1/os-snapshots/99087a1c-f856-48ab-8447-60c985794219 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:19:16.382113 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-cd803758-bcc0-4b93-aaf3-ce066d890384 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Calling method '.version_select at 0x7f7f646700d0>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:16.406794 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-cd803758-bcc0-4b93-aaf3-ce066d890384 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] HTTP exception thrown: Snapshot 99087a1c-f856-48ab-8447-60c985794219 could not be found. Feb 09 13:19:16.407394 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-cd803758-bcc0-4b93-aaf3-ce066d890384 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Returning 404 to user: Snapshot 99087a1c-f856-48ab-8447-60c985794219 could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:19:16.408221 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-cd803758-bcc0-4b93-aaf3-ce066d890384 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/99087a1c-f856-48ab-8447-60c985794219" status: 404 len: 111 microversion: 2.1 time: 0.030961 Feb 09 13:19:16.408745 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 461/941] 10.222.0.84 () {58 vars in 1250 bytes} [Wed Feb 9 13:19:16 2022] GET /compute/v2.1/os-snapshots/99087a1c-f856-48ab-8447-60c985794219 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:19:16.417123 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-7852f767-6f82-4786-aa88-28a6c8f8a71c tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Calling method '.version_select at 0x7f7f6459a3a0>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:16.694484 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-7852f767-6f82-4786-aa88-28a6c8f8a71c tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/894cb762-da19-4fe7-bbb4-d4afd0f55251" status: 202 len: 0 microversion: 2.1 time: 0.281446 Feb 09 13:19:16.695094 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 481/942] 10.222.0.84 () {58 vars in 1247 bytes} [Wed Feb 9 13:19:16 2022] DELETE /compute/v2.1/os-volumes/894cb762-da19-4fe7-bbb4-d4afd0f55251 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:19:16.702971 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-7133b9b2-8591-438a-8be5-77481c59ae28 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Calling method '.version_select at 0x7f7f646659d0>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:16.749820 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-7133b9b2-8591-438a-8be5-77481c59ae28 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/894cb762-da19-4fe7-bbb4-d4afd0f55251" status: 200 len: 345 microversion: 2.1 time: 0.050416 Feb 09 13:19:16.750375 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 462/943] 10.222.0.84 () {58 vars in 1244 bytes} [Wed Feb 9 13:19:16 2022] GET /compute/v2.1/os-volumes/894cb762-da19-4fe7-bbb4-d4afd0f55251 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:19:17.761805 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-23b20035-b7e7-4389-a0be-1b36dd67b8b1 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Calling method '.version_select at 0x7f7f6467ddc0>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:17.806788 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-23b20035-b7e7-4389-a0be-1b36dd67b8b1 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/894cb762-da19-4fe7-bbb4-d4afd0f55251" status: 200 len: 345 microversion: 2.1 time: 0.049072 Feb 09 13:19:17.807351 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 482/944] 10.222.0.84 () {58 vars in 1244 bytes} [Wed Feb 9 13:19:17 2022] GET /compute/v2.1/os-volumes/894cb762-da19-4fe7-bbb4-d4afd0f55251 => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:19:18.819423 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-3b6241bf-e78b-476e-a7b2-afdce5ba6ba8 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Calling method '.version_select at 0x7f7f6469d670>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:18.864908 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-3b6241bf-e78b-476e-a7b2-afdce5ba6ba8 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/894cb762-da19-4fe7-bbb4-d4afd0f55251" status: 200 len: 345 microversion: 2.1 time: 0.049471 Feb 09 13:19:18.865468 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 463/945] 10.222.0.84 () {58 vars in 1244 bytes} [Wed Feb 9 13:19:18 2022] GET /compute/v2.1/os-volumes/894cb762-da19-4fe7-bbb4-d4afd0f55251 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:19:19.878037 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-898bb837-cb87-44c7-83c3-6282e56d6ee9 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Calling method '.version_select at 0x7f7f6465adc0>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:19.907082 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.wsgi [None req-898bb837-cb87-44c7-83c3-6282e56d6ee9 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] HTTP exception thrown: Volume 894cb762-da19-4fe7-bbb4-d4afd0f55251 could not be found. Feb 09 13:19:19.908125 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-898bb837-cb87-44c7-83c3-6282e56d6ee9 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Returning 404 to user: Volume 894cb762-da19-4fe7-bbb4-d4afd0f55251 could not be found. {{(pid=116748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:19:19.909601 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-898bb837-cb87-44c7-83c3-6282e56d6ee9 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/894cb762-da19-4fe7-bbb4-d4afd0f55251" status: 404 len: 109 microversion: 2.1 time: 0.035653 Feb 09 13:19:19.910567 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 483/946] 10.222.0.84 () {58 vars in 1244 bytes} [Wed Feb 9 13:19:19 2022] GET /compute/v2.1/os-volumes/894cb762-da19-4fe7-bbb4-d4afd0f55251 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 09 13:19:19.919757 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-42876a5f-e234-4fe3-ab10-660a6f336c86 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Calling method '.version_select at 0x7f7f651915e0>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:19.949812 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-42876a5f-e234-4fe3-ab10-660a6f336c86 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] HTTP exception thrown: Volume 894cb762-da19-4fe7-bbb4-d4afd0f55251 could not be found. Feb 09 13:19:19.950500 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-42876a5f-e234-4fe3-ab10-660a6f336c86 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Returning 404 to user: Volume 894cb762-da19-4fe7-bbb4-d4afd0f55251 could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:19:19.951359 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-42876a5f-e234-4fe3-ab10-660a6f336c86 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/894cb762-da19-4fe7-bbb4-d4afd0f55251" status: 404 len: 109 microversion: 2.1 time: 0.035515 Feb 09 13:19:19.951901 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 464/947] 10.222.0.84 () {58 vars in 1247 bytes} [Wed Feb 9 13:19:19 2022] DELETE /compute/v2.1/os-volumes/894cb762-da19-4fe7-bbb4-d4afd0f55251 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:19:19.960308 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-e5b28a69-84cf-4d72-9832-824d58b59e40 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Calling method '.version_select at 0x7f7f6465a430>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:19.986127 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.wsgi [None req-e5b28a69-84cf-4d72-9832-824d58b59e40 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] HTTP exception thrown: Volume 894cb762-da19-4fe7-bbb4-d4afd0f55251 could not be found. Feb 09 13:19:19.986808 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-e5b28a69-84cf-4d72-9832-824d58b59e40 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] Returning 404 to user: Volume 894cb762-da19-4fe7-bbb4-d4afd0f55251 could not be found. {{(pid=116748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:19:19.987663 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-e5b28a69-84cf-4d72-9832-824d58b59e40 tempest-VolumesSnapshotsTestJSON-1771874436 tempest-VolumesSnapshotsTestJSON-1771874436-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/894cb762-da19-4fe7-bbb4-d4afd0f55251" status: 404 len: 109 microversion: 2.1 time: 0.031717 Feb 09 13:19:19.988187 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 484/948] 10.222.0.84 () {58 vars in 1244 bytes} [Wed Feb 9 13:19:19 2022] GET /compute/v2.1/os-volumes/894cb762-da19-4fe7-bbb4-d4afd0f55251 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:19:22.141924 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-1087558e-70de-4fa7-9d84-2493bd3f9941 tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] Action: 'create', calling method: .version_select at 0x7f7f64f29ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-512440366", "metadata": {"Type": "work"}}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:19:22.143396 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-1087558e-70de-4fa7-9d84-2493bd3f9941 tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:19:22.144252 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-1087558e-70de-4fa7-9d84-2493bd3f9941 tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] 10.222.0.84 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.114684 Feb 09 13:19:22.144782 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 465/949] 10.222.0.84 () {60 vars in 1155 bytes} [Wed Feb 9 13:19:22 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 09 13:19:22.155663 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-102c477b-44d4-4967-bdc7-06604a04ad82 tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] Action: 'create', calling method: .version_select at 0x7f7f6481faf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1108283395", "metadata": {"Type": "work"}}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:19:22.157077 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-102c477b-44d4-4967-bdc7-06604a04ad82 tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:19:22.157914 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-102c477b-44d4-4967-bdc7-06604a04ad82 tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] 10.222.0.84 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007343 Feb 09 13:19:22.158415 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 485/950] 10.222.0.84 () {60 vars in 1155 bytes} [Wed Feb 9 13:19:22 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 09 13:19:22.166695 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-e3856cff-bd31-4e4e-a9b2-7cf09e68c3bc tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] Action: 'create', calling method: .version_select at 0x7f7f646651f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-437268546", "metadata": {"Type": "work"}}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:19:22.170633 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-e3856cff-bd31-4e4e-a9b2-7cf09e68c3bc tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:19:22.170633 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-e3856cff-bd31-4e4e-a9b2-7cf09e68c3bc tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] 10.222.0.84 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005562 Feb 09 13:19:22.170633 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 466/951] 10.222.0.84 () {60 vars in 1155 bytes} [Wed Feb 9 13:19:22 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 09 13:19:22.181327 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-257717a9-d27e-4aad-a23a-b5a6ca21dda7 tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] Calling method '.version_select at 0x7f7f6465a4c0>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:22.209056 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.wsgi [None req-257717a9-d27e-4aad-a23a-b5a6ca21dda7 tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] HTTP exception thrown: Volume tempest-invalid-1738340159 could not be found. Feb 09 13:19:22.209741 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-257717a9-d27e-4aad-a23a-b5a6ca21dda7 tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] Returning 404 to user: Volume tempest-invalid-1738340159 could not be found. {{(pid=116748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:19:22.210678 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-257717a9-d27e-4aad-a23a-b5a6ca21dda7 tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1738340159" status: 404 len: 99 microversion: 2.1 time: 0.033447 Feb 09 13:19:22.211223 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 486/952] 10.222.0.84 () {58 vars in 1217 bytes} [Wed Feb 9 13:19:22 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1738340159 => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 09 13:19:22.220666 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-61ecc707-b6aa-4b39-aa47-4822b71b5ce2 tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003721 Feb 09 13:19:22.221182 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 467/953] 10.222.0.84 () {58 vars in 1139 bytes} [Wed Feb 9 13:19:22 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Feb 09 13:19:22.231325 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-caa06373-8c23-418f-a340-bcd73a59e194 tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004829 Feb 09 13:19:22.231911 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 487/954] 10.222.0.84 () {58 vars in 1136 bytes} [Wed Feb 9 13:19:22 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Feb 09 13:19:22.241468 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-0c067eb5-4b38-4d3d-9c5f-882c370d7063 tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] Calling method '.version_select at 0x7f7f651915e0>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:22.269439 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-0c067eb5-4b38-4d3d-9c5f-882c370d7063 tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] HTTP exception thrown: Volume ec9c6b71-a96f-4f4c-be2c-f4650916c6a0 could not be found. Feb 09 13:19:22.270051 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-0c067eb5-4b38-4d3d-9c5f-882c370d7063 tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] Returning 404 to user: Volume ec9c6b71-a96f-4f4c-be2c-f4650916c6a0 could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:19:22.270925 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-0c067eb5-4b38-4d3d-9c5f-882c370d7063 tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/ec9c6b71-a96f-4f4c-be2c-f4650916c6a0" status: 404 len: 109 microversion: 2.1 time: 0.034156 Feb 09 13:19:22.271472 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 468/955] 10.222.0.84 () {58 vars in 1247 bytes} [Wed Feb 9 13:19:22 2022] DELETE /compute/v2.1/os-volumes/ec9c6b71-a96f-4f4c-be2c-f4650916c6a0 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:19:22.280978 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d4751fd2-178a-4553-9416-23a8ba2234f1 tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] Calling method '.version_select at 0x7f7f6459a430>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:22.308142 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.wsgi [None req-d4751fd2-178a-4553-9416-23a8ba2234f1 tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] HTTP exception thrown: Volume 3af539ba-2953-46ee-a436-3b222bba3dff could not be found. Feb 09 13:19:22.308725 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d4751fd2-178a-4553-9416-23a8ba2234f1 tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] Returning 404 to user: Volume 3af539ba-2953-46ee-a436-3b222bba3dff could not be found. {{(pid=116748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:19:22.309687 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d4751fd2-178a-4553-9416-23a8ba2234f1 tempest-VolumesNegativeTest-1217364745 tempest-VolumesNegativeTest-1217364745-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/3af539ba-2953-46ee-a436-3b222bba3dff" status: 404 len: 109 microversion: 2.1 time: 0.032728 Feb 09 13:19:22.310222 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 488/956] 10.222.0.84 () {58 vars in 1244 bytes} [Wed Feb 9 13:19:22 2022] GET /compute/v2.1/os-volumes/3af539ba-2953-46ee-a436-3b222bba3dff => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:19:23.678850 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-06c1611b-7e47-4287-afa2-8e25874da9b1 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:23.681033 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-06c1611b-7e47-4287-afa2-8e25874da9b1 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 42178215-9fb7-4685-970f-b29241775bf8] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:23.686435 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-06c1611b-7e47-4287-afa2-8e25874da9b1 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:23.686916 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-06c1611b-7e47-4287-afa2-8e25874da9b1 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:23.687707 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-06c1611b-7e47-4287-afa2-8e25874da9b1 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:23.688147 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-06c1611b-7e47-4287-afa2-8e25874da9b1 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:23.771952 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.objects.instance [None req-06c1611b-7e47-4287-afa2-8e25874da9b1 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lazy-loading 'services' on Instance uuid 42178215-9fb7-4685-970f-b29241775bf8 {{(pid=116749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:19:23.993809 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-06c1611b-7e47-4287-afa2-8e25874da9b1 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "DELETE /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8/os-volume_attachments/6f9542fb-8619-4a11-b86f-781ef6b91e70" status: 202 len: 0 microversion: 2.1 time: 0.318948 Feb 09 13:19:23.994333 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 469/957] 10.222.0.84 () {58 vars in 1415 bytes} [Wed Feb 9 13:19:23 2022] DELETE /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8/os-volume_attachments/6f9542fb-8619-4a11-b86f-781ef6b91e70 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:19:25.108242 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-53affc39-3412-4e79-b791-5724820cc734 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:25.112494 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-53affc39-3412-4e79-b791-5724820cc734 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 42178215-9fb7-4685-970f-b29241775bf8] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:25.117659 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-53affc39-3412-4e79-b791-5724820cc734 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:25.118180 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-53affc39-3412-4e79-b791-5724820cc734 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:25.119048 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-53affc39-3412-4e79-b791-5724820cc734 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:25.119494 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-53affc39-3412-4e79-b791-5724820cc734 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:25.147821 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-53affc39-3412-4e79-b791-5724820cc734 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 42178215-9fb7-4685-970f-b29241775bf8] Going to try to terminate instance {{(pid=116748) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 09 13:19:25.437481 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-53affc39-3412-4e79-b791-5724820cc734 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "DELETE /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8" status: 204 len: 0 microversion: 2.1 time: 0.334334 Feb 09 13:19:25.438076 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 489/958] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:19:25 2022] DELETE /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 09 13:19:25.447679 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-22a8dd4a-9434-47e7-8d00-63925b1edecc tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:25.448388 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-22a8dd4a-9434-47e7-8d00-63925b1edecc tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 42178215-9fb7-4685-970f-b29241775bf8] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:25.454918 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-22a8dd4a-9434-47e7-8d00-63925b1edecc tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:25.456807 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-22a8dd4a-9434-47e7-8d00-63925b1edecc tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:25.456807 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-22a8dd4a-9434-47e7-8d00-63925b1edecc tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:25.456807 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-22a8dd4a-9434-47e7-8d00-63925b1edecc tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:25.612170 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-22a8dd4a-9434-47e7-8d00-63925b1edecc tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:25.620450 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-22a8dd4a-9434-47e7-8d00-63925b1edecc tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8" status: 200 len: 1513 microversion: 2.1 time: 0.177864 Feb 09 13:19:25.621059 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 470/959] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:25 2022] GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8 => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:19:26.639023 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-a7506660-bff3-4aa7-aa5e-4caf0c6c6c09 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:26.640121 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-a7506660-bff3-4aa7-aa5e-4caf0c6c6c09 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 42178215-9fb7-4685-970f-b29241775bf8] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:26.645969 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a7506660-bff3-4aa7-aa5e-4caf0c6c6c09 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:26.649905 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a7506660-bff3-4aa7-aa5e-4caf0c6c6c09 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:26.649905 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a7506660-bff3-4aa7-aa5e-4caf0c6c6c09 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:26.649905 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-a7506660-bff3-4aa7-aa5e-4caf0c6c6c09 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:26.788585 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-a7506660-bff3-4aa7-aa5e-4caf0c6c6c09 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:26.796058 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-a7506660-bff3-4aa7-aa5e-4caf0c6c6c09 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8" status: 200 len: 1513 microversion: 2.1 time: 0.161592 Feb 09 13:19:26.796633 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 490/960] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:26 2022] GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:19:27.813882 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-4b517c4b-d222-42ae-9f9f-241318bd91e5 req-2afd5835-f316-4d27-bce1-e393efebfdcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42178215-9fb7-4685-970f-b29241775bf8", "name": "network-vif-deleted", "tag": "912514c5-6a6f-413f-8293-ed22414868a1"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:19:27.814363 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:19:27.814363 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:19:27.814571 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-1de6ac0d-0a50-4aea-aa63-34c39dc2ae9d tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:27.815288 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-1de6ac0d-0a50-4aea-aa63-34c39dc2ae9d tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 42178215-9fb7-4685-970f-b29241775bf8] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:27.822676 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-4b517c4b-d222-42ae-9f9f-241318bd91e5 req-2afd5835-f316-4d27-bce1-e393efebfdcf service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:27.823098 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1de6ac0d-0a50-4aea-aa63-34c39dc2ae9d tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:27.823447 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-4b517c4b-d222-42ae-9f9f-241318bd91e5 req-2afd5835-f316-4d27-bce1-e393efebfdcf service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:27.823609 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1de6ac0d-0a50-4aea-aa63-34c39dc2ae9d tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:27.824433 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1de6ac0d-0a50-4aea-aa63-34c39dc2ae9d tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:27.824875 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1de6ac0d-0a50-4aea-aa63-34c39dc2ae9d tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:27.835787 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-4b517c4b-d222-42ae-9f9f-241318bd91e5 req-2afd5835-f316-4d27-bce1-e393efebfdcf service nova] Creating event network-vif-deleted:912514c5-6a6f-413f-8293-ed22414868a1 for instance 42178215-9fb7-4685-970f-b29241775bf8 on hv-cinder-82786 Feb 09 13:19:27.840912 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-4b517c4b-d222-42ae-9f9f-241318bd91e5 req-2afd5835-f316-4d27-bce1-e393efebfdcf service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033430 Feb 09 13:19:27.842352 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 471/961] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:19:27.893636 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-1de6ac0d-0a50-4aea-aa63-34c39dc2ae9d tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:27.901855 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-1de6ac0d-0a50-4aea-aa63-34c39dc2ae9d tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8" status: 200 len: 1471 microversion: 2.1 time: 0.092582 Feb 09 13:19:27.902778 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 491/962] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:27 2022] GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8 => generated 1471 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:19:28.921478 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-1e504350-44be-4550-b682-008c7fcb5f97 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:28.922160 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-1e504350-44be-4550-b682-008c7fcb5f97 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 42178215-9fb7-4685-970f-b29241775bf8] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:28.928697 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1e504350-44be-4550-b682-008c7fcb5f97 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:28.929672 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1e504350-44be-4550-b682-008c7fcb5f97 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:28.930507 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1e504350-44be-4550-b682-008c7fcb5f97 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:28.930979 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1e504350-44be-4550-b682-008c7fcb5f97 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:28.943894 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-1e504350-44be-4550-b682-008c7fcb5f97 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] HTTP exception thrown: Instance 42178215-9fb7-4685-970f-b29241775bf8 could not be found. Feb 09 13:19:28.944423 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-1e504350-44be-4550-b682-008c7fcb5f97 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Returning 404 to user: Instance 42178215-9fb7-4685-970f-b29241775bf8 could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:19:28.945946 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-1e504350-44be-4550-b682-008c7fcb5f97 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8" status: 404 len: 111 microversion: 2.1 time: 0.029836 Feb 09 13:19:28.946466 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 472/963] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:28 2022] GET /compute/v2.1/servers/42178215-9fb7-4685-970f-b29241775bf8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:19:39.372044 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d374f3a0-8b91-4e15-a412-b4f922e80658 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1572676841", "imageRef": "af86cedd-e7d5-4a28-a810-f47830f4bffc", "flavorRef": "452", "networks": [{"uuid": "6fafe0f3-5d30-4182-9532-b8b1dd4db528"}]}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:19:39.424584 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.network.neutron [None req-d374f3a0-8b91-4e15-a412-b4f922e80658 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] validate_networks() for [('6fafe0f3-5d30-4182-9532-b8b1dd4db528', None, None, None, None, None)] {{(pid=116748) validate_networks /opt/stack/nova/nova/network/neutron.py:2554}} Feb 09 13:19:39.853495 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-d374f3a0-8b91-4e15-a412-b4f922e80658 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Flavor limits 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 09 13:19:39.853962 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-d374f3a0-8b91-4e15-a412-b4f922e80658 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Image limits 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 09 13:19:39.854448 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-d374f3a0-8b91-4e15-a412-b4f922e80658 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Flavor pref 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 09 13:19:39.854931 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-d374f3a0-8b91-4e15-a412-b4f922e80658 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Image pref 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 09 13:19:39.855301 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-d374f3a0-8b91-4e15-a412-b4f922e80658 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 09 13:19:39.863999 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d374f3a0-8b91-4e15-a412-b4f922e80658 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:39.864462 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d374f3a0-8b91-4e15-a412-b4f922e80658 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:39.865290 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d374f3a0-8b91-4e15-a412-b4f922e80658 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:39.865724 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d374f3a0-8b91-4e15-a412-b4f922e80658 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:39.881791 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-d374f3a0-8b91-4e15-a412-b4f922e80658 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Getting quotas for project 6d127cc9afbd483ebeab270c62efa251. Resources: {'instances', 'cores', 'ram'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:19:39.886248 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-d374f3a0-8b91-4e15-a412-b4f922e80658 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Getting quotas for user 1cd19dc7d2494fe58118b14496455883 and project 6d127cc9afbd483ebeab270c62efa251. Resources: {'instances', 'cores', 'ram'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:19:39.896870 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d374f3a0-8b91-4e15-a412-b4f922e80658 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Going to run 1 instances... {{(pid=116748) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 09 13:19:39.899785 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d374f3a0-8b91-4e15-a412-b4f922e80658 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 5a601aac-7dbb-498f-ba4d-76af285c06e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af86cedd-e7d5-4a28-a810-f47830f4bffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 09 13:19:40.047533 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d374f3a0-8b91-4e15-a412-b4f922e80658 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679326 Feb 09 13:19:40.048181 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 492/964] 10.222.0.84 () {60 vars in 1146 bytes} [Wed Feb 9 13:19:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 09 13:19:40.057941 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-4aa9fe79-0da4-4ef7-b198-048cd8009e53 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:40.058685 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-4aa9fe79-0da4-4ef7-b198-048cd8009e53 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 5a601aac-7dbb-498f-ba4d-76af285c06e5] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:40.116101 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-4aa9fe79-0da4-4ef7-b198-048cd8009e53 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:40.122786 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-4aa9fe79-0da4-4ef7-b198-048cd8009e53 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5" status: 200 len: 1219 microversion: 2.1 time: 0.068571 Feb 09 13:19:40.123348 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 473/965] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:40 2022] GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:19:41.138810 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d30b66b3-9549-4f5c-a5de-bced504e3c7e tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:41.139485 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d30b66b3-9549-4f5c-a5de-bced504e3c7e tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 5a601aac-7dbb-498f-ba4d-76af285c06e5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:41.149479 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d30b66b3-9549-4f5c-a5de-bced504e3c7e tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:41.149870 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d30b66b3-9549-4f5c-a5de-bced504e3c7e tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:41.150684 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d30b66b3-9549-4f5c-a5de-bced504e3c7e tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:41.151117 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d30b66b3-9549-4f5c-a5de-bced504e3c7e tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:41.217629 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d30b66b3-9549-4f5c-a5de-bced504e3c7e tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:41.227561 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d30b66b3-9549-4f5c-a5de-bced504e3c7e tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5" status: 200 len: 1223 microversion: 2.1 time: 0.092311 Feb 09 13:19:41.228139 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 493/966] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:41 2022] GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:19:42.243364 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-e47bab25-50d8-4064-9d56-3be88923ad82 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:42.243975 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-e47bab25-50d8-4064-9d56-3be88923ad82 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 5a601aac-7dbb-498f-ba4d-76af285c06e5] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:42.252296 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e47bab25-50d8-4064-9d56-3be88923ad82 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:42.252749 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e47bab25-50d8-4064-9d56-3be88923ad82 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:42.253642 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e47bab25-50d8-4064-9d56-3be88923ad82 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:42.254133 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e47bab25-50d8-4064-9d56-3be88923ad82 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:42.327716 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-e47bab25-50d8-4064-9d56-3be88923ad82 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:42.335228 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-e47bab25-50d8-4064-9d56-3be88923ad82 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5" status: 200 len: 1279 microversion: 2.1 time: 0.095348 Feb 09 13:19:42.336487 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 474/967] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:42 2022] GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5 => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:19:43.352266 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-ef434dd6-3669-4bdd-abb2-0218570af9d4 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:43.352915 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-ef434dd6-3669-4bdd-abb2-0218570af9d4 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 5a601aac-7dbb-498f-ba4d-76af285c06e5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:43.359475 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ef434dd6-3669-4bdd-abb2-0218570af9d4 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:43.359935 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ef434dd6-3669-4bdd-abb2-0218570af9d4 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:43.360778 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ef434dd6-3669-4bdd-abb2-0218570af9d4 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:43.361222 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-ef434dd6-3669-4bdd-abb2-0218570af9d4 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:43.500062 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-ef434dd6-3669-4bdd-abb2-0218570af9d4 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:43.507986 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-ef434dd6-3669-4bdd-abb2-0218570af9d4 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5" status: 200 len: 1319 microversion: 2.1 time: 0.158856 Feb 09 13:19:43.508566 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 494/968] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:43 2022] GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:19:44.087516 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-2fc39a30-a0da-4b9b-99e2-7ae2a4a33bd9 req-4937416d-0ef4-4b8f-8a35-335f320d2bfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a601aac-7dbb-498f-ba4d-76af285c06e5", "tag": "fc8410c3-602e-483a-acb8-90febda053d9"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:19:44.091475 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:19:44.091475 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:19:44.102213 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-2fc39a30-a0da-4b9b-99e2-7ae2a4a33bd9 req-4937416d-0ef4-4b8f-8a35-335f320d2bfe service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:44.102213 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-2fc39a30-a0da-4b9b-99e2-7ae2a4a33bd9 req-4937416d-0ef4-4b8f-8a35-335f320d2bfe service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:44.119477 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-2fc39a30-a0da-4b9b-99e2-7ae2a4a33bd9 req-4937416d-0ef4-4b8f-8a35-335f320d2bfe service nova] Creating event network-changed:fc8410c3-602e-483a-acb8-90febda053d9 for instance 5a601aac-7dbb-498f-ba4d-76af285c06e5 on hv-cinder-82786 Feb 09 13:19:44.124620 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-2fc39a30-a0da-4b9b-99e2-7ae2a4a33bd9 req-4937416d-0ef4-4b8f-8a35-335f320d2bfe service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047536 Feb 09 13:19:44.125160 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 475/969] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:19:44.530204 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-002163e9-633d-4610-bdf7-e2ab2c3263e0 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:44.530204 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-002163e9-633d-4610-bdf7-e2ab2c3263e0 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 5a601aac-7dbb-498f-ba4d-76af285c06e5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:44.531883 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-002163e9-633d-4610-bdf7-e2ab2c3263e0 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:44.532327 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-002163e9-633d-4610-bdf7-e2ab2c3263e0 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:44.533106 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-002163e9-633d-4610-bdf7-e2ab2c3263e0 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:44.533539 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-002163e9-633d-4610-bdf7-e2ab2c3263e0 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:44.678541 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-002163e9-633d-4610-bdf7-e2ab2c3263e0 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:44.687415 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-002163e9-633d-4610-bdf7-e2ab2c3263e0 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5" status: 200 len: 1319 microversion: 2.1 time: 0.165911 Feb 09 13:19:44.688807 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 495/970] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:44 2022] GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:19:45.705410 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-1fc4a984-8d81-4a34-87f3-dcfed842ed1a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:45.706090 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-1fc4a984-8d81-4a34-87f3-dcfed842ed1a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 5a601aac-7dbb-498f-ba4d-76af285c06e5] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:45.712604 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1fc4a984-8d81-4a34-87f3-dcfed842ed1a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:45.713047 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1fc4a984-8d81-4a34-87f3-dcfed842ed1a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:45.713820 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1fc4a984-8d81-4a34-87f3-dcfed842ed1a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:45.714248 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1fc4a984-8d81-4a34-87f3-dcfed842ed1a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:46.106168 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-1fc4a984-8d81-4a34-87f3-dcfed842ed1a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:46.116464 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-1fc4a984-8d81-4a34-87f3-dcfed842ed1a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5" status: 200 len: 1319 microversion: 2.1 time: 0.412665 Feb 09 13:19:46.116464 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 476/971] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:45 2022] GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5 => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:19:47.129858 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-3ada2784-ab2a-4f2b-ad84-a190b54b3e72 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:47.130638 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-3ada2784-ab2a-4f2b-ad84-a190b54b3e72 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 5a601aac-7dbb-498f-ba4d-76af285c06e5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:47.138406 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3ada2784-ab2a-4f2b-ad84-a190b54b3e72 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:47.142685 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3ada2784-ab2a-4f2b-ad84-a190b54b3e72 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:47.142685 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3ada2784-ab2a-4f2b-ad84-a190b54b3e72 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:47.142685 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3ada2784-ab2a-4f2b-ad84-a190b54b3e72 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:47.281867 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-3ada2784-ab2a-4f2b-ad84-a190b54b3e72 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:47.290231 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-3ada2784-ab2a-4f2b-ad84-a190b54b3e72 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5" status: 200 len: 1319 microversion: 2.1 time: 0.163859 Feb 09 13:19:47.299919 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 496/972] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:47 2022] GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:19:48.307935 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-0777d345-9b0f-41e6-a392-b4f0bbb0f12f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:48.308544 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-0777d345-9b0f-41e6-a392-b4f0bbb0f12f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 5a601aac-7dbb-498f-ba4d-76af285c06e5] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:48.314803 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0777d345-9b0f-41e6-a392-b4f0bbb0f12f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:48.315251 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0777d345-9b0f-41e6-a392-b4f0bbb0f12f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:48.316024 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0777d345-9b0f-41e6-a392-b4f0bbb0f12f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:48.316468 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0777d345-9b0f-41e6-a392-b4f0bbb0f12f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:48.380963 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-b3c17b22-43d2-474e-8c86-ba26027c632c tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:48.381478 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-b3c17b22-43d2-474e-8c86-ba26027c632c tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:48.388410 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b3c17b22-43d2-474e-8c86-ba26027c632c tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:48.388957 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b3c17b22-43d2-474e-8c86-ba26027c632c tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:48.389833 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b3c17b22-43d2-474e-8c86-ba26027c632c tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:48.390381 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b3c17b22-43d2-474e-8c86-ba26027c632c tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:48.417375 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-b3c17b22-43d2-474e-8c86-ba26027c632c tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Going to try to terminate instance {{(pid=116748) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 09 13:19:48.455062 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-0777d345-9b0f-41e6-a392-b4f0bbb0f12f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:48.463482 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-0777d345-9b0f-41e6-a392-b4f0bbb0f12f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5" status: 200 len: 1319 microversion: 2.1 time: 0.159547 Feb 09 13:19:48.464134 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 477/973] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:48 2022] GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:19:48.823297 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-b3c17b22-43d2-474e-8c86-ba26027c632c tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "DELETE /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 204 len: 0 microversion: 2.1 time: 0.445758 Feb 09 13:19:48.824005 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 497/974] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:19:48 2022] DELETE /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 09 13:19:48.832133 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-685d2d34-f14d-4adc-862e-2b5fc2420d32 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:48.832748 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-685d2d34-f14d-4adc-862e-2b5fc2420d32 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:48.839211 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-685d2d34-f14d-4adc-862e-2b5fc2420d32 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:48.839669 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-685d2d34-f14d-4adc-862e-2b5fc2420d32 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:48.840457 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-685d2d34-f14d-4adc-862e-2b5fc2420d32 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:48.840895 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-685d2d34-f14d-4adc-862e-2b5fc2420d32 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:48.981597 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-685d2d34-f14d-4adc-862e-2b5fc2420d32 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:48.988942 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-685d2d34-f14d-4adc-862e-2b5fc2420d32 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1578 microversion: 2.1 time: 0.160483 Feb 09 13:19:48.989505 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 478/975] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:48 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:19:49.218986 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-c1804e4f-974a-48b6-ac99-1d1aeea4b46a req-7007cf6b-0dc8-4670-bde8-2442f037bed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a601aac-7dbb-498f-ba4d-76af285c06e5", "name": "network-vif-plugged", "status": "completed", "tag": "fc8410c3-602e-483a-acb8-90febda053d9"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:19:49.220696 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:19:49.220696 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:19:49.227718 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-c1804e4f-974a-48b6-ac99-1d1aeea4b46a req-7007cf6b-0dc8-4670-bde8-2442f037bed2 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:49.228160 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-c1804e4f-974a-48b6-ac99-1d1aeea4b46a req-7007cf6b-0dc8-4670-bde8-2442f037bed2 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:49.245651 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-c1804e4f-974a-48b6-ac99-1d1aeea4b46a req-7007cf6b-0dc8-4670-bde8-2442f037bed2 service nova] Creating event network-vif-plugged:fc8410c3-602e-483a-acb8-90febda053d9 for instance 5a601aac-7dbb-498f-ba4d-76af285c06e5 on hv-cinder-82786 Feb 09 13:19:49.246165 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-c1804e4f-974a-48b6-ac99-1d1aeea4b46a req-7007cf6b-0dc8-4670-bde8-2442f037bed2 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031223 Feb 09 13:19:49.246781 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 498/976] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:19:49.478982 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ceb3bfe0-1fa7-4979-9fa6-bbcffdbf4af3 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:49.479714 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-ceb3bfe0-1fa7-4979-9fa6-bbcffdbf4af3 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 5a601aac-7dbb-498f-ba4d-76af285c06e5] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:49.486021 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ceb3bfe0-1fa7-4979-9fa6-bbcffdbf4af3 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:49.486479 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ceb3bfe0-1fa7-4979-9fa6-bbcffdbf4af3 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:49.487365 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ceb3bfe0-1fa7-4979-9fa6-bbcffdbf4af3 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:49.487808 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ceb3bfe0-1fa7-4979-9fa6-bbcffdbf4af3 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:49.684401 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ceb3bfe0-1fa7-4979-9fa6-bbcffdbf4af3 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:49.691897 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-ceb3bfe0-1fa7-4979-9fa6-bbcffdbf4af3 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5" status: 200 len: 1319 microversion: 2.1 time: 0.216565 Feb 09 13:19:49.692461 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 479/977] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:49 2022] GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:19:50.006442 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-17d09b23-2cfb-4539-8f74-68f3f9f647bd tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:50.007086 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-17d09b23-2cfb-4539-8f74-68f3f9f647bd tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:50.013498 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-17d09b23-2cfb-4539-8f74-68f3f9f647bd tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:50.013953 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-17d09b23-2cfb-4539-8f74-68f3f9f647bd tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:50.014763 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-17d09b23-2cfb-4539-8f74-68f3f9f647bd tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:50.015202 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-17d09b23-2cfb-4539-8f74-68f3f9f647bd tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:50.148756 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-17d09b23-2cfb-4539-8f74-68f3f9f647bd tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:50.156182 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-17d09b23-2cfb-4539-8f74-68f3f9f647bd tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1578 microversion: 2.1 time: 0.153792 Feb 09 13:19:50.156746 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 499/978] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:50 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:19:50.708554 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-0dc5ef4c-cad7-4fe4-a19f-418988255a1f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:50.709162 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-0dc5ef4c-cad7-4fe4-a19f-418988255a1f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 5a601aac-7dbb-498f-ba4d-76af285c06e5] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:50.715562 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0dc5ef4c-cad7-4fe4-a19f-418988255a1f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:50.716007 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0dc5ef4c-cad7-4fe4-a19f-418988255a1f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:50.716788 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0dc5ef4c-cad7-4fe4-a19f-418988255a1f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:50.717240 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0dc5ef4c-cad7-4fe4-a19f-418988255a1f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:50.856679 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-0dc5ef4c-cad7-4fe4-a19f-418988255a1f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:50.864094 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-0dc5ef4c-cad7-4fe4-a19f-418988255a1f tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5" status: 200 len: 1319 microversion: 2.1 time: 0.159379 Feb 09 13:19:50.864659 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 480/979] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:50 2022] GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:19:51.173388 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-e2665793-5007-480d-b5ff-6c4da3782681 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:51.174000 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-e2665793-5007-480d-b5ff-6c4da3782681 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:51.180938 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e2665793-5007-480d-b5ff-6c4da3782681 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:51.181384 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e2665793-5007-480d-b5ff-6c4da3782681 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:51.182380 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e2665793-5007-480d-b5ff-6c4da3782681 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:51.183093 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e2665793-5007-480d-b5ff-6c4da3782681 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:51.419869 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e2665793-5007-480d-b5ff-6c4da3782681 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:51.427968 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-e2665793-5007-480d-b5ff-6c4da3782681 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1578 microversion: 2.1 time: 0.258332 Feb 09 13:19:51.438381 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 500/980] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:51 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1578 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:19:51.881517 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-1c34f9a1-aea7-4cc5-9e5f-84c914b3bd7a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:51.882811 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-1c34f9a1-aea7-4cc5-9e5f-84c914b3bd7a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 5a601aac-7dbb-498f-ba4d-76af285c06e5] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:51.892304 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1c34f9a1-aea7-4cc5-9e5f-84c914b3bd7a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:51.893043 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1c34f9a1-aea7-4cc5-9e5f-84c914b3bd7a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:51.894239 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1c34f9a1-aea7-4cc5-9e5f-84c914b3bd7a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:51.895034 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1c34f9a1-aea7-4cc5-9e5f-84c914b3bd7a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:51.921849 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-4fe6bc96-7893-41d6-8d5f-eeff86ee3a2a req-a193d041-2043-4774-8033-722c5061b147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "794b82e0-8aad-46b1-9e9e-9cfb0d16abf5", "name": "network-vif-deleted", "tag": "cde48d4a-b667-4fb2-8210-2d6efb90a93a"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:19:51.923759 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:19:51.923759 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:19:51.933621 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-4fe6bc96-7893-41d6-8d5f-eeff86ee3a2a req-a193d041-2043-4774-8033-722c5061b147 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:51.935348 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-4fe6bc96-7893-41d6-8d5f-eeff86ee3a2a req-a193d041-2043-4774-8033-722c5061b147 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:51.950551 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-4fe6bc96-7893-41d6-8d5f-eeff86ee3a2a req-a193d041-2043-4774-8033-722c5061b147 service nova] Creating event network-vif-deleted:cde48d4a-b667-4fb2-8210-2d6efb90a93a for instance 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 on hv-cinder-82786 Feb 09 13:19:51.956856 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-4fe6bc96-7893-41d6-8d5f-eeff86ee3a2a req-a193d041-2043-4774-8033-722c5061b147 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038443 Feb 09 13:19:51.957885 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 501/981] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:19:52.080605 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-1c34f9a1-aea7-4cc5-9e5f-84c914b3bd7a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:52.090278 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-1c34f9a1-aea7-4cc5-9e5f-84c914b3bd7a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5" status: 200 len: 1508 microversion: 2.1 time: 0.213254 Feb 09 13:19:52.101321 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 481/982] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:51 2022] GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5 => generated 1508 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:19:52.109634 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d72f7952-0859-47c4-8f92-719fa4454293 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a78a4b6e-c385-4bcb-a8bb-a43f656bcd89", "device": "/dev/sdb"}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:19:52.112707 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d72f7952-0859-47c4-8f92-719fa4454293 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 5a601aac-7dbb-498f-ba4d-76af285c06e5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:52.120576 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d72f7952-0859-47c4-8f92-719fa4454293 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:52.121206 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d72f7952-0859-47c4-8f92-719fa4454293 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:52.122296 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d72f7952-0859-47c4-8f92-719fa4454293 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:52.123002 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d72f7952-0859-47c4-8f92-719fa4454293 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:52.445917 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-a5eb90ac-e4a9-4535-b0ec-e873b7c96248 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:52.447643 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-a5eb90ac-e4a9-4535-b0ec-e873b7c96248 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:52.455180 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a5eb90ac-e4a9-4535-b0ec-e873b7c96248 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:52.455924 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a5eb90ac-e4a9-4535-b0ec-e873b7c96248 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:52.457551 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a5eb90ac-e4a9-4535-b0ec-e873b7c96248 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:52.458267 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a5eb90ac-e4a9-4535-b0ec-e873b7c96248 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:52.504622 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a5eb90ac-e4a9-4535-b0ec-e873b7c96248 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:52.505160 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a5eb90ac-e4a9-4535-b0ec-e873b7c96248 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:52.505685 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.objects.instance [None req-a5eb90ac-e4a9-4535-b0ec-e873b7c96248 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lazy-loading 'fault' on Instance uuid 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 {{(pid=116749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:19:52.552771 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-a5eb90ac-e4a9-4535-b0ec-e873b7c96248 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:52.561877 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-a5eb90ac-e4a9-4535-b0ec-e873b7c96248 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 200 len: 1230 microversion: 2.1 time: 0.120474 Feb 09 13:19:52.562863 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 482/983] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:52 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 1230 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:19:52.990531 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d72f7952-0859-47c4-8f92-719fa4454293 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "POST /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.886996 Feb 09 13:19:53.000165 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 502/984] 10.222.0.84 () {60 vars in 1322 bytes} [Wed Feb 9 13:19:52 2022] POST /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5/os-volume_attachments => generated 194 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:19:53.579517 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-812a0559-d379-49c0-a5a7-667262c10350 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:53.580128 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-812a0559-d379-49c0-a5a7-667262c10350 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:53.586911 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-812a0559-d379-49c0-a5a7-667262c10350 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:53.587361 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-812a0559-d379-49c0-a5a7-667262c10350 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:53.588148 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-812a0559-d379-49c0-a5a7-667262c10350 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:53.588584 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-812a0559-d379-49c0-a5a7-667262c10350 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:53.601536 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-812a0559-d379-49c0-a5a7-667262c10350 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] HTTP exception thrown: Instance 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 could not be found. Feb 09 13:19:53.602133 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-812a0559-d379-49c0-a5a7-667262c10350 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Returning 404 to user: Instance 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:19:53.602993 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-812a0559-d379-49c0-a5a7-667262c10350 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 404 len: 111 microversion: 2.1 time: 0.027316 Feb 09 13:19:53.603545 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 483/985] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:53 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:19:53.710345 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-0bb8d2ff-c1f0-4cf9-9fd3-142f14efc85b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1150196971", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-423323945", "security_groups": [{"name": "tempest-secgroup-smoke-147747940"}], "block_device_mapping_v2": [{"uuid": "76b08560-4cba-4e7a-a167-876eca2790f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05ef35c6-6e26-4081-883e-e7a7d012ab72"}]}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:19:53.821375 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.network.neutron [None req-0bb8d2ff-c1f0-4cf9-9fd3-142f14efc85b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] validate_networks() for [('05ef35c6-6e26-4081-883e-e7a7d012ab72', None, None, None, None, None)] {{(pid=116748) validate_networks /opt/stack/nova/nova/network/neutron.py:2554}} Feb 09 13:19:54.248960 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-0bb8d2ff-c1f0-4cf9-9fd3-142f14efc85b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Flavor limits 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 09 13:19:54.249516 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-0bb8d2ff-c1f0-4cf9-9fd3-142f14efc85b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Image limits 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 09 13:19:54.249881 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-0bb8d2ff-c1f0-4cf9-9fd3-142f14efc85b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Flavor pref 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 09 13:19:54.250292 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-0bb8d2ff-c1f0-4cf9-9fd3-142f14efc85b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Image pref 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 09 13:19:54.250755 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-0bb8d2ff-c1f0-4cf9-9fd3-142f14efc85b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 09 13:19:54.259307 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0bb8d2ff-c1f0-4cf9-9fd3-142f14efc85b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:54.259758 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0bb8d2ff-c1f0-4cf9-9fd3-142f14efc85b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:54.260587 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0bb8d2ff-c1f0-4cf9-9fd3-142f14efc85b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:54.261029 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0bb8d2ff-c1f0-4cf9-9fd3-142f14efc85b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:54.281851 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-0bb8d2ff-c1f0-4cf9-9fd3-142f14efc85b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Getting quotas for project d5ef8e70a161475ab7130108627df2e4. Resources: {'instances', 'cores', 'ram'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:19:54.283863 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-0bb8d2ff-c1f0-4cf9-9fd3-142f14efc85b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Getting quotas for user 11b331092b7645388e37636426326374 and project d5ef8e70a161475ab7130108627df2e4. Resources: {'instances', 'cores', 'ram'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:19:54.345847 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-0bb8d2ff-c1f0-4cf9-9fd3-142f14efc85b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Going to run 1 instances... {{(pid=116748) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 09 13:19:54.348105 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-0bb8d2ff-c1f0-4cf9-9fd3-142f14efc85b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='76b08560-4cba-4e7a-a167-876eca2790f6',volume_size=None,volume_type=None)] {{(pid=116748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 09 13:19:54.829657 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-0bb8d2ff-c1f0-4cf9-9fd3-142f14efc85b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.123925 Feb 09 13:19:54.830312 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 503/986] 10.222.0.84 () {60 vars in 1146 bytes} [Wed Feb 9 13:19:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 09 13:19:54.840209 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-0e304481-5ad1-49eb-8d6f-a97782433865 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:54.840770 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-0e304481-5ad1-49eb-8d6f-a97782433865 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:54.896923 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-0e304481-5ad1-49eb-8d6f-a97782433865 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:54.904240 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-0e304481-5ad1-49eb-8d6f-a97782433865 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1094 microversion: 2.1 time: 0.067503 Feb 09 13:19:54.904976 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 484/987] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:54 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:19:55.922719 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-c670eba0-a88a-43bd-ae59-55bc899f9ec4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:55.923496 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-c670eba0-a88a-43bd-ae59-55bc899f9ec4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:55.930368 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c670eba0-a88a-43bd-ae59-55bc899f9ec4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:55.930844 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c670eba0-a88a-43bd-ae59-55bc899f9ec4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:55.931743 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c670eba0-a88a-43bd-ae59-55bc899f9ec4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:55.932153 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c670eba0-a88a-43bd-ae59-55bc899f9ec4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:55.994221 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-c670eba0-a88a-43bd-ae59-55bc899f9ec4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:56.001574 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-c670eba0-a88a-43bd-ae59-55bc899f9ec4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1144 microversion: 2.1 time: 0.084196 Feb 09 13:19:56.002770 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 504/988] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:55 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:19:57.019397 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d5b6e728-a089-495b-abf8-2604a9cc70cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:57.020789 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d5b6e728-a089-495b-abf8-2604a9cc70cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:57.027395 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d5b6e728-a089-495b-abf8-2604a9cc70cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:57.027853 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d5b6e728-a089-495b-abf8-2604a9cc70cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:57.028648 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d5b6e728-a089-495b-abf8-2604a9cc70cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:57.029350 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d5b6e728-a089-495b-abf8-2604a9cc70cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:57.097503 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-d5b6e728-a089-495b-abf8-2604a9cc70cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:57.105033 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d5b6e728-a089-495b-abf8-2604a9cc70cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1200 microversion: 2.1 time: 0.089319 Feb 09 13:19:57.114862 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 485/989] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:57 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1200 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:19:58.128629 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-4751586e-9018-4a39-b698-12b61014cb3d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:58.129258 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-4751586e-9018-4a39-b698-12b61014cb3d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:58.137228 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4751586e-9018-4a39-b698-12b61014cb3d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:58.138424 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4751586e-9018-4a39-b698-12b61014cb3d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:58.138602 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4751586e-9018-4a39-b698-12b61014cb3d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:58.139133 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4751586e-9018-4a39-b698-12b61014cb3d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:58.310139 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-4751586e-9018-4a39-b698-12b61014cb3d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:58.317512 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-4751586e-9018-4a39-b698-12b61014cb3d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1277 microversion: 2.1 time: 0.192559 Feb 09 13:19:58.318770 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 505/990] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:58 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1277 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:19:58.856348 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-3c99c71b-e011-4934-bc2b-6c92037a5dc8 req-a0b1cf0d-de5d-4431-9825-325d790c6a1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f2ac1f9-be36-466a-ac50-831c548547c7", "tag": "d0473794-25d6-4297-bd7b-f2930167cb57"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:19:58.858576 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:19:58.858576 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:19:58.872189 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-3c99c71b-e011-4934-bc2b-6c92037a5dc8 req-a0b1cf0d-de5d-4431-9825-325d790c6a1c service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:58.875849 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-3c99c71b-e011-4934-bc2b-6c92037a5dc8 req-a0b1cf0d-de5d-4431-9825-325d790c6a1c service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:58.883861 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-3c99c71b-e011-4934-bc2b-6c92037a5dc8 req-a0b1cf0d-de5d-4431-9825-325d790c6a1c service nova] Creating event network-changed:d0473794-25d6-4297-bd7b-f2930167cb57 for instance 3f2ac1f9-be36-466a-ac50-831c548547c7 on hv-cinder-82786 Feb 09 13:19:58.889100 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-3c99c71b-e011-4934-bc2b-6c92037a5dc8 req-a0b1cf0d-de5d-4431-9825-325d790c6a1c service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036908 Feb 09 13:19:58.889791 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 486/991] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:19:59.336093 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-fffca735-574a-4373-acdb-190a40d23363 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:19:59.337000 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-fffca735-574a-4373-acdb-190a40d23363 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:19:59.344384 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fffca735-574a-4373-acdb-190a40d23363 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:59.345052 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fffca735-574a-4373-acdb-190a40d23363 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:59.346231 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fffca735-574a-4373-acdb-190a40d23363 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:19:59.346859 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fffca735-574a-4373-acdb-190a40d23363 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:19:59.494233 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-fffca735-574a-4373-acdb-190a40d23363 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:19:59.502255 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-fffca735-574a-4373-acdb-190a40d23363 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1277 microversion: 2.1 time: 0.169990 Feb 09 13:19:59.502928 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 506/992] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:19:59 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:20:00.520664 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-fceb49d2-76df-4a80-8029-e26f9661a621 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:20:00.521516 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-fceb49d2-76df-4a80-8029-e26f9661a621 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:20:00.533431 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-fceb49d2-76df-4a80-8029-e26f9661a621 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:00.533933 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-fceb49d2-76df-4a80-8029-e26f9661a621 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:00.534956 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-fceb49d2-76df-4a80-8029-e26f9661a621 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:00.535428 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-fceb49d2-76df-4a80-8029-e26f9661a621 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:00.689266 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-fceb49d2-76df-4a80-8029-e26f9661a621 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:20:00.697065 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-fceb49d2-76df-4a80-8029-e26f9661a621 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1277 microversion: 2.1 time: 0.180448 Feb 09 13:20:00.697643 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 487/993] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:20:00 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:20:01.715177 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-3f880556-0023-4804-b80c-07c4ded3a8a1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:20:01.716246 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-3f880556-0023-4804-b80c-07c4ded3a8a1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:20:01.722928 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3f880556-0023-4804-b80c-07c4ded3a8a1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:01.723432 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3f880556-0023-4804-b80c-07c4ded3a8a1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:01.724239 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3f880556-0023-4804-b80c-07c4ded3a8a1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:01.724684 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3f880556-0023-4804-b80c-07c4ded3a8a1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:01.916075 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-3f880556-0023-4804-b80c-07c4ded3a8a1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:20:01.924349 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-3f880556-0023-4804-b80c-07c4ded3a8a1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1265 microversion: 2.1 time: 0.214582 Feb 09 13:20:01.938954 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 507/994] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:20:01 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:20:02.945924 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-bb0977a5-d196-49e3-a284-4d88a1743b10 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:20:02.946543 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-bb0977a5-d196-49e3-a284-4d88a1743b10 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:20:02.952944 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bb0977a5-d196-49e3-a284-4d88a1743b10 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:02.953449 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bb0977a5-d196-49e3-a284-4d88a1743b10 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:02.954532 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bb0977a5-d196-49e3-a284-4d88a1743b10 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:02.955207 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-bb0977a5-d196-49e3-a284-4d88a1743b10 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:03.099134 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-bb0977a5-d196-49e3-a284-4d88a1743b10 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:20:03.112042 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-bb0977a5-d196-49e3-a284-4d88a1743b10 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1265 microversion: 2.1 time: 0.165498 Feb 09 13:20:03.112042 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 488/995] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:20:02 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:20:04.126942 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-064f7f04-4216-4b26-aae6-85385c77f526 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:20:04.127488 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-064f7f04-4216-4b26-aae6-85385c77f526 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:20:04.133810 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-064f7f04-4216-4b26-aae6-85385c77f526 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:04.134272 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-064f7f04-4216-4b26-aae6-85385c77f526 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:04.135130 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-064f7f04-4216-4b26-aae6-85385c77f526 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:04.136398 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-064f7f04-4216-4b26-aae6-85385c77f526 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:04.389709 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-064f7f04-4216-4b26-aae6-85385c77f526 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:20:04.397170 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-064f7f04-4216-4b26-aae6-85385c77f526 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1265 microversion: 2.1 time: 0.274127 Feb 09 13:20:04.397747 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 508/996] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:20:04 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1265 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:20:05.413753 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-b2bf8e8e-6f1c-40fb-84ec-5b6b96554ce7 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:20:05.414403 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-b2bf8e8e-6f1c-40fb-84ec-5b6b96554ce7 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:20:05.421442 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b2bf8e8e-6f1c-40fb-84ec-5b6b96554ce7 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:05.421897 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b2bf8e8e-6f1c-40fb-84ec-5b6b96554ce7 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:05.422717 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b2bf8e8e-6f1c-40fb-84ec-5b6b96554ce7 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:05.423160 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-b2bf8e8e-6f1c-40fb-84ec-5b6b96554ce7 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:05.711146 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-b2bf8e8e-6f1c-40fb-84ec-5b6b96554ce7 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:20:05.718677 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-b2bf8e8e-6f1c-40fb-84ec-5b6b96554ce7 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1265 microversion: 2.1 time: 0.308474 Feb 09 13:20:05.719257 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 489/997] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:20:05 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1265 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:20:06.736407 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-277e3993-8e3e-49a0-8e86-93cc47bbe664 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:20:06.737027 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-277e3993-8e3e-49a0-8e86-93cc47bbe664 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:20:06.743360 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-277e3993-8e3e-49a0-8e86-93cc47bbe664 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:06.743817 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-277e3993-8e3e-49a0-8e86-93cc47bbe664 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:06.744611 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-277e3993-8e3e-49a0-8e86-93cc47bbe664 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:06.745058 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-277e3993-8e3e-49a0-8e86-93cc47bbe664 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:06.875191 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-277e3993-8e3e-49a0-8e86-93cc47bbe664 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:20:06.882624 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-277e3993-8e3e-49a0-8e86-93cc47bbe664 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1265 microversion: 2.1 time: 0.149916 Feb 09 13:20:06.883192 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 509/998] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:20:06 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:20:07.899614 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-5a89c938-c49e-403e-9f95-b5226ccadb14 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:20:07.900280 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-5a89c938-c49e-403e-9f95-b5226ccadb14 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:20:07.906860 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5a89c938-c49e-403e-9f95-b5226ccadb14 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:07.907319 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5a89c938-c49e-403e-9f95-b5226ccadb14 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:07.908102 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5a89c938-c49e-403e-9f95-b5226ccadb14 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:07.908545 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5a89c938-c49e-403e-9f95-b5226ccadb14 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:08.044831 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-5a89c938-c49e-403e-9f95-b5226ccadb14 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:20:08.052417 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-5a89c938-c49e-403e-9f95-b5226ccadb14 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1265 microversion: 2.1 time: 0.156437 Feb 09 13:20:08.053013 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 490/999] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:20:07 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:20:09.073896 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-0b15d2fd-0484-407b-968e-6855c46067ae tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:20:09.079093 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-0b15d2fd-0484-407b-968e-6855c46067ae tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:20:09.085999 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0b15d2fd-0484-407b-968e-6855c46067ae tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:09.087084 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0b15d2fd-0484-407b-968e-6855c46067ae tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:09.087897 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0b15d2fd-0484-407b-968e-6855c46067ae tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:09.088342 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-0b15d2fd-0484-407b-968e-6855c46067ae tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:09.229601 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-0b15d2fd-0484-407b-968e-6855c46067ae tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:20:09.236974 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-0b15d2fd-0484-407b-968e-6855c46067ae tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1265 microversion: 2.1 time: 0.167717 Feb 09 13:20:09.237541 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 510/1000] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:20:09 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:20:10.252974 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-1f28ff87-575b-4b88-a2c9-c23531a64596 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:20:10.253584 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-1f28ff87-575b-4b88-a2c9-c23531a64596 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:20:10.265536 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1f28ff87-575b-4b88-a2c9-c23531a64596 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:10.265993 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1f28ff87-575b-4b88-a2c9-c23531a64596 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:10.266842 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1f28ff87-575b-4b88-a2c9-c23531a64596 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:10.267280 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1f28ff87-575b-4b88-a2c9-c23531a64596 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:10.401922 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-1f28ff87-575b-4b88-a2c9-c23531a64596 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:20:10.410023 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-1f28ff87-575b-4b88-a2c9-c23531a64596 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1265 microversion: 2.1 time: 0.160670 Feb 09 13:20:10.410520 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 491/1001] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:20:10 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:20:11.426652 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-6951beff-46f6-4f58-a83c-dff15e66d1c1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:20:11.427309 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-6951beff-46f6-4f58-a83c-dff15e66d1c1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:20:11.433647 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6951beff-46f6-4f58-a83c-dff15e66d1c1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:11.434104 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6951beff-46f6-4f58-a83c-dff15e66d1c1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:11.435490 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6951beff-46f6-4f58-a83c-dff15e66d1c1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:11.435937 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-6951beff-46f6-4f58-a83c-dff15e66d1c1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:11.569346 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-6951beff-46f6-4f58-a83c-dff15e66d1c1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:20:11.576934 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-6951beff-46f6-4f58-a83c-dff15e66d1c1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1265 microversion: 2.1 time: 0.154178 Feb 09 13:20:11.577578 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 511/1002] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:20:11 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:20:12.594017 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-4f19b147-66e4-4553-ae2d-f48e002d3fde tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:20:12.594664 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-4f19b147-66e4-4553-ae2d-f48e002d3fde tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:20:12.600874 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4f19b147-66e4-4553-ae2d-f48e002d3fde tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:12.601329 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4f19b147-66e4-4553-ae2d-f48e002d3fde tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:12.602128 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4f19b147-66e4-4553-ae2d-f48e002d3fde tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:12.602595 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4f19b147-66e4-4553-ae2d-f48e002d3fde tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:12.740989 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-4f19b147-66e4-4553-ae2d-f48e002d3fde tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:20:12.748861 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-4f19b147-66e4-4553-ae2d-f48e002d3fde tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1265 microversion: 2.1 time: 0.158659 Feb 09 13:20:12.751575 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 492/1003] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:20:12 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:20:13.091673 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-64d6c560-54cd-47ac-ad93-3128d1a204f9 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:20:13.092208 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-64d6c560-54cd-47ac-ad93-3128d1a204f9 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 5a601aac-7dbb-498f-ba4d-76af285c06e5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:20:13.098834 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-64d6c560-54cd-47ac-ad93-3128d1a204f9 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:13.099361 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-64d6c560-54cd-47ac-ad93-3128d1a204f9 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:13.100167 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-64d6c560-54cd-47ac-ad93-3128d1a204f9 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:13.100609 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-64d6c560-54cd-47ac-ad93-3128d1a204f9 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:13.180439 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-64d6c560-54cd-47ac-ad93-3128d1a204f9 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lazy-loading 'services' on Instance uuid 5a601aac-7dbb-498f-ba4d-76af285c06e5 {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:20:13.328453 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-7ca1a4a2-0fe3-4dbb-bc70-e9f734946a9d req-75fafa3e-6fa2-4dc3-b28d-b5de92a7a25d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f2ac1f9-be36-466a-ac50-831c548547c7", "name": "network-vif-plugged", "status": "completed", "tag": "d0473794-25d6-4297-bd7b-f2930167cb57"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:20:13.330066 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:20:13.330066 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:20:13.336787 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-7ca1a4a2-0fe3-4dbb-bc70-e9f734946a9d req-75fafa3e-6fa2-4dc3-b28d-b5de92a7a25d service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:13.337238 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-7ca1a4a2-0fe3-4dbb-bc70-e9f734946a9d req-75fafa3e-6fa2-4dc3-b28d-b5de92a7a25d service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:13.347704 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-7ca1a4a2-0fe3-4dbb-bc70-e9f734946a9d req-75fafa3e-6fa2-4dc3-b28d-b5de92a7a25d service nova] Creating event network-vif-plugged:d0473794-25d6-4297-bd7b-f2930167cb57 for instance 3f2ac1f9-be36-466a-ac50-831c548547c7 on hv-cinder-82786 Feb 09 13:20:13.352724 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-7ca1a4a2-0fe3-4dbb-bc70-e9f734946a9d req-75fafa3e-6fa2-4dc3-b28d-b5de92a7a25d service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028469 Feb 09 13:20:13.353300 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 493/1004] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:20:13.398190 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-64d6c560-54cd-47ac-ad93-3128d1a204f9 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "DELETE /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5/os-volume_attachments/a78a4b6e-c385-4bcb-a8bb-a43f656bcd89" status: 202 len: 0 microversion: 2.1 time: 0.310716 Feb 09 13:20:13.398829 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 512/1005] 10.222.0.84 () {58 vars in 1415 bytes} [Wed Feb 9 13:20:13 2022] DELETE /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5/os-volume_attachments/a78a4b6e-c385-4bcb-a8bb-a43f656bcd89 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:20:13.766867 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-5344cf47-257d-4bc5-b552-15f1e2d08b50 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:20:13.767574 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-5344cf47-257d-4bc5-b552-15f1e2d08b50 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:20:13.773705 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5344cf47-257d-4bc5-b552-15f1e2d08b50 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:13.774158 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5344cf47-257d-4bc5-b552-15f1e2d08b50 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:13.774971 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5344cf47-257d-4bc5-b552-15f1e2d08b50 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:13.775413 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-5344cf47-257d-4bc5-b552-15f1e2d08b50 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:13.915905 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-5344cf47-257d-4bc5-b552-15f1e2d08b50 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:20:13.923556 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-5344cf47-257d-4bc5-b552-15f1e2d08b50 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1265 microversion: 2.1 time: 0.161766 Feb 09 13:20:13.924134 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 494/1006] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:20:13 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:20:14.941332 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d44fb389-3e0b-47e1-91a8-a0193c4977aa tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:20:14.942032 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d44fb389-3e0b-47e1-91a8-a0193c4977aa tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:20:14.947973 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d44fb389-3e0b-47e1-91a8-a0193c4977aa tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:14.948432 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d44fb389-3e0b-47e1-91a8-a0193c4977aa tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:14.949214 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d44fb389-3e0b-47e1-91a8-a0193c4977aa tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:14.949653 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d44fb389-3e0b-47e1-91a8-a0193c4977aa tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:15.093728 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d44fb389-3e0b-47e1-91a8-a0193c4977aa tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:20:15.101289 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d44fb389-3e0b-47e1-91a8-a0193c4977aa tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1453 microversion: 2.1 time: 0.164435 Feb 09 13:20:15.101859 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 513/1007] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:20:14 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:20:15.117121 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-a4432dd2-7366-4e4c-8f63-5c59beae04e3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:20:15.117735 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-a4432dd2-7366-4e4c-8f63-5c59beae04e3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:20:15.123946 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a4432dd2-7366-4e4c-8f63-5c59beae04e3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:15.124407 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a4432dd2-7366-4e4c-8f63-5c59beae04e3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:15.125193 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a4432dd2-7366-4e4c-8f63-5c59beae04e3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:15.125637 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a4432dd2-7366-4e4c-8f63-5c59beae04e3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:15.268117 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-a4432dd2-7366-4e4c-8f63-5c59beae04e3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:20:15.275643 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-a4432dd2-7366-4e4c-8f63-5c59beae04e3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1453 microversion: 2.1 time: 0.162329 Feb 09 13:20:15.276199 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 495/1008] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:20:15 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:20:15.569728 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-86c9c584-fc18-4486-815e-d362b06c1d6e tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:20:15.570662 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-86c9c584-fc18-4486-815e-d362b06c1d6e tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 5a601aac-7dbb-498f-ba4d-76af285c06e5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:20:15.576951 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-86c9c584-fc18-4486-815e-d362b06c1d6e tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:15.577404 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-86c9c584-fc18-4486-815e-d362b06c1d6e tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:15.578269 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-86c9c584-fc18-4486-815e-d362b06c1d6e tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:15.578822 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-86c9c584-fc18-4486-815e-d362b06c1d6e tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:15.610901 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-86c9c584-fc18-4486-815e-d362b06c1d6e tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 5a601aac-7dbb-498f-ba4d-76af285c06e5] Going to try to terminate instance {{(pid=116748) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 09 13:20:15.940959 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-86c9c584-fc18-4486-815e-d362b06c1d6e tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "DELETE /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5" status: 204 len: 0 microversion: 2.1 time: 0.374601 Feb 09 13:20:15.941708 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 514/1009] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:20:15 2022] DELETE /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 09 13:20:15.949970 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-0ba1b611-8d11-46dc-9553-34b48d1ad947 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:20:15.950695 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-0ba1b611-8d11-46dc-9553-34b48d1ad947 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 5a601aac-7dbb-498f-ba4d-76af285c06e5] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:20:15.956993 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0ba1b611-8d11-46dc-9553-34b48d1ad947 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:15.958785 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0ba1b611-8d11-46dc-9553-34b48d1ad947 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:15.958785 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0ba1b611-8d11-46dc-9553-34b48d1ad947 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:15.958785 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-0ba1b611-8d11-46dc-9553-34b48d1ad947 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:16.205854 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-0ba1b611-8d11-46dc-9553-34b48d1ad947 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:20:16.214292 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-0ba1b611-8d11-46dc-9553-34b48d1ad947 tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5" status: 200 len: 1514 microversion: 2.1 time: 0.267940 Feb 09 13:20:16.214832 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 496/1010] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:20:15 2022] GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5 => generated 1514 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:20:17.233901 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d64df8b5-fbd7-4fa7-ac28-fb208d89744a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:20:17.234857 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d64df8b5-fbd7-4fa7-ac28-fb208d89744a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 5a601aac-7dbb-498f-ba4d-76af285c06e5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:20:17.241620 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d64df8b5-fbd7-4fa7-ac28-fb208d89744a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:17.242151 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d64df8b5-fbd7-4fa7-ac28-fb208d89744a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:17.242987 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d64df8b5-fbd7-4fa7-ac28-fb208d89744a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:17.243426 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d64df8b5-fbd7-4fa7-ac28-fb208d89744a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:17.391644 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d64df8b5-fbd7-4fa7-ac28-fb208d89744a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:20:17.399240 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d64df8b5-fbd7-4fa7-ac28-fb208d89744a tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5" status: 200 len: 1514 microversion: 2.1 time: 0.170288 Feb 09 13:20:17.399904 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 515/1011] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:20:17 2022] GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:20:17.582905 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-c3d5fb84-d599-4cfd-8ba9-3c7aaea5d584 req-b7f44862-cf7f-4904-986e-cfc48cbc87f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f2ac1f9-be36-466a-ac50-831c548547c7", "tag": "d0473794-25d6-4297-bd7b-f2930167cb57"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:20:17.585962 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:20:17.585962 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:20:17.592483 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-c3d5fb84-d599-4cfd-8ba9-3c7aaea5d584 req-b7f44862-cf7f-4904-986e-cfc48cbc87f0 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:17.592856 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-c3d5fb84-d599-4cfd-8ba9-3c7aaea5d584 req-b7f44862-cf7f-4904-986e-cfc48cbc87f0 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:17.603931 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-c3d5fb84-d599-4cfd-8ba9-3c7aaea5d584 req-b7f44862-cf7f-4904-986e-cfc48cbc87f0 service nova] Creating event network-changed:d0473794-25d6-4297-bd7b-f2930167cb57 for instance 3f2ac1f9-be36-466a-ac50-831c548547c7 on hv-cinder-82786 Feb 09 13:20:17.608702 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-c3d5fb84-d599-4cfd-8ba9-3c7aaea5d584 req-b7f44862-cf7f-4904-986e-cfc48cbc87f0 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029298 Feb 09 13:20:17.609441 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 497/1012] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:20:18.422600 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-03a79cb0-665c-4eae-9d3e-5e5336d2224c tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:20:18.423744 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-03a79cb0-665c-4eae-9d3e-5e5336d2224c tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 5a601aac-7dbb-498f-ba4d-76af285c06e5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:20:18.431126 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-03a79cb0-665c-4eae-9d3e-5e5336d2224c tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:18.431781 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-03a79cb0-665c-4eae-9d3e-5e5336d2224c tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:18.432792 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-03a79cb0-665c-4eae-9d3e-5e5336d2224c tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:18.433469 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-03a79cb0-665c-4eae-9d3e-5e5336d2224c tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:18.512274 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-03a79cb0-665c-4eae-9d3e-5e5336d2224c tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd19dc7d2494fe58118b14496455883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d127cc9afbd483ebeab270c62efa251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:20:18.520599 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-03a79cb0-665c-4eae-9d3e-5e5336d2224c tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5" status: 200 len: 1472 microversion: 2.1 time: 0.107005 Feb 09 13:20:18.521457 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 516/1013] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:20:18 2022] GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5 => generated 1472 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:20:19.538475 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-79174fd4-ca32-44bf-b5d0-b215f500967c tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:20:19.539211 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-79174fd4-ca32-44bf-b5d0-b215f500967c tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] [instance: 5a601aac-7dbb-498f-ba4d-76af285c06e5] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:20:19.545256 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-79174fd4-ca32-44bf-b5d0-b215f500967c tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:19.545711 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-79174fd4-ca32-44bf-b5d0-b215f500967c tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:19.546506 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-79174fd4-ca32-44bf-b5d0-b215f500967c tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:19.546973 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-79174fd4-ca32-44bf-b5d0-b215f500967c tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:19.560301 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-79174fd4-ca32-44bf-b5d0-b215f500967c tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] HTTP exception thrown: Instance 5a601aac-7dbb-498f-ba4d-76af285c06e5 could not be found. Feb 09 13:20:19.565791 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-79174fd4-ca32-44bf-b5d0-b215f500967c tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] Returning 404 to user: Instance 5a601aac-7dbb-498f-ba4d-76af285c06e5 could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:20:19.565791 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-79174fd4-ca32-44bf-b5d0-b215f500967c tempest-VolumesSnapshotTestJSON-786938842 tempest-VolumesSnapshotTestJSON-786938842-project] 10.222.0.84 "GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5" status: 404 len: 111 microversion: 2.1 time: 0.027855 Feb 09 13:20:19.565791 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 498/1014] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:20:19 2022] GET /compute/v2.1/servers/5a601aac-7dbb-498f-ba4d-76af285c06e5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:20:19.623940 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-4f56a313-94cd-48b9-b5ef-0e61ede773b6 req-82517a9c-584a-47d4-bf74-ef82b1ac9f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a601aac-7dbb-498f-ba4d-76af285c06e5", "name": "network-vif-deleted", "tag": "fc8410c3-602e-483a-acb8-90febda053d9"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:20:19.625555 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:20:19.625555 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:20:19.632805 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-4f56a313-94cd-48b9-b5ef-0e61ede773b6 req-82517a9c-584a-47d4-bf74-ef82b1ac9f32 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:20:19.633258 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-4f56a313-94cd-48b9-b5ef-0e61ede773b6 req-82517a9c-584a-47d4-bf74-ef82b1ac9f32 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:20:19.645003 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-4f56a313-94cd-48b9-b5ef-0e61ede773b6 req-82517a9c-584a-47d4-bf74-ef82b1ac9f32 service nova] Creating event network-vif-deleted:fc8410c3-602e-483a-acb8-90febda053d9 for instance 5a601aac-7dbb-498f-ba4d-76af285c06e5 on hv-cinder-82786 Feb 09 13:20:19.649774 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-4f56a313-94cd-48b9-b5ef-0e61ede773b6 req-82517a9c-584a-47d4-bf74-ef82b1ac9f32 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030150 Feb 09 13:20:19.650371 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 517/1015] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:20:59.933565 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-7da9c3f4-e96e-48ec-996e-ca1ea9217f23 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Action: 'create', calling method: .version_select at 0x7f7f64f27940>, body: {"keypair": {"name": "tempest-TestShelveInstance-2100513966"}} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:20:59.947537 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-7da9c3f4-e96e-48ec-996e-ca1ea9217f23 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Getting quotas for project a995617c26584027b41b908107d1482b. Resources: {'key_pairs'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:20:59.952572 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-7da9c3f4-e96e-48ec-996e-ca1ea9217f23 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Getting quotas for user 86cf88d385f840d4808997bcc4aa24b7 and project a995617c26584027b41b908107d1482b. Resources: {'key_pairs'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:21:00.225693 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-7da9c3f4-e96e-48ec-996e-ca1ea9217f23 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Getting quotas for project a995617c26584027b41b908107d1482b. Resources: {'key_pairs'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:21:00.229355 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.quota [None req-7da9c3f4-e96e-48ec-996e-ca1ea9217f23 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Getting quotas for user 86cf88d385f840d4808997bcc4aa24b7 and project a995617c26584027b41b908107d1482b. Resources: {'key_pairs'} {{(pid=116749) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:21:00.241738 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-7da9c3f4-e96e-48ec-996e-ca1ea9217f23 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.472264 Feb 09 13:21:00.242313 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 499/1016] 10.222.0.84 () {60 vars in 1157 bytes} [Wed Feb 9 13:20:59 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:21:18.319415 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 09 13:21:18.320045 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: Wed Feb 9 13:21:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 09 13:21:20.225727 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d77bd50a-85bc-4cc3-8fd0-dfbb5a9c17a9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1082634966", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2100513966", "security_groups": [{"name": "tempest-secgroup-smoke-96809161"}], "networks": [{"uuid": "092e799c-3856-4065-b316-ee99869a22fb"}], "block_device_mapping_v2": [{"uuid": "37678857-a9e2-48dd-99ef-d4e88a26eaf8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:21:20.432945 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.network.neutron [None req-d77bd50a-85bc-4cc3-8fd0-dfbb5a9c17a9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] validate_networks() for [('092e799c-3856-4065-b316-ee99869a22fb', None, None, None, None, None)] {{(pid=116748) validate_networks /opt/stack/nova/nova/network/neutron.py:2554}} Feb 09 13:21:20.799335 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-d77bd50a-85bc-4cc3-8fd0-dfbb5a9c17a9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Flavor limits 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 09 13:21:20.799762 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-d77bd50a-85bc-4cc3-8fd0-dfbb5a9c17a9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Image limits 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 09 13:21:20.800236 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-d77bd50a-85bc-4cc3-8fd0-dfbb5a9c17a9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Flavor pref 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 09 13:21:20.800643 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-d77bd50a-85bc-4cc3-8fd0-dfbb5a9c17a9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Image pref 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 09 13:21:20.801054 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-d77bd50a-85bc-4cc3-8fd0-dfbb5a9c17a9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 09 13:21:20.809791 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d77bd50a-85bc-4cc3-8fd0-dfbb5a9c17a9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:20.810241 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d77bd50a-85bc-4cc3-8fd0-dfbb5a9c17a9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:20.811097 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d77bd50a-85bc-4cc3-8fd0-dfbb5a9c17a9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:20.811537 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d77bd50a-85bc-4cc3-8fd0-dfbb5a9c17a9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:20.827562 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-d77bd50a-85bc-4cc3-8fd0-dfbb5a9c17a9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Getting quotas for project a995617c26584027b41b908107d1482b. Resources: {'instances', 'cores', 'ram'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:21:20.831427 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-d77bd50a-85bc-4cc3-8fd0-dfbb5a9c17a9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Getting quotas for user 86cf88d385f840d4808997bcc4aa24b7 and project a995617c26584027b41b908107d1482b. Resources: {'instances', 'cores', 'ram'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:21:20.884339 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d77bd50a-85bc-4cc3-8fd0-dfbb5a9c17a9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Going to run 1 instances... {{(pid=116748) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 09 13:21:20.887146 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d77bd50a-85bc-4cc3-8fd0-dfbb5a9c17a9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='37678857-a9e2-48dd-99ef-d4e88a26eaf8',volume_size=None,volume_type=None)] {{(pid=116748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 09 13:21:21.387800 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d77bd50a-85bc-4cc3-8fd0-dfbb5a9c17a9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.167445 Feb 09 13:21:21.388607 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 518/1017] 10.222.0.84 () {60 vars in 1146 bytes} [Wed Feb 9 13:21:20 2022] POST /compute/v2.1/servers => generated 404 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 09 13:21:21.398197 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-5a2ac823-9cff-488c-9e03-ac439842cd9d tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:21:21.398843 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-5a2ac823-9cff-488c-9e03-ac439842cd9d tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:21:21.549384 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-5a2ac823-9cff-488c-9e03-ac439842cd9d tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:21:21.555957 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-5a2ac823-9cff-488c-9e03-ac439842cd9d tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1089 microversion: 2.1 time: 0.161525 Feb 09 13:21:21.556509 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 500/1018] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:21:21 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1089 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:21:22.573681 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d677b94c-104a-4c87-b2a4-be91c1bd5e14 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:21:22.574290 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d677b94c-104a-4c87-b2a4-be91c1bd5e14 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:21:22.581223 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d677b94c-104a-4c87-b2a4-be91c1bd5e14 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:22.581675 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d677b94c-104a-4c87-b2a4-be91c1bd5e14 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:22.582597 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d677b94c-104a-4c87-b2a4-be91c1bd5e14 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:22.582991 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d677b94c-104a-4c87-b2a4-be91c1bd5e14 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:22.642586 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d677b94c-104a-4c87-b2a4-be91c1bd5e14 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:21:22.650213 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d677b94c-104a-4c87-b2a4-be91c1bd5e14 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1139 microversion: 2.1 time: 0.080883 Feb 09 13:21:22.656287 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 519/1019] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:21:22 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:21:23.668675 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-beb64ed6-06f3-49a4-82b2-f16c940c377f tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:21:23.669334 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-beb64ed6-06f3-49a4-82b2-f16c940c377f tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:21:23.675476 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-beb64ed6-06f3-49a4-82b2-f16c940c377f tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:23.675993 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-beb64ed6-06f3-49a4-82b2-f16c940c377f tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:23.680323 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-beb64ed6-06f3-49a4-82b2-f16c940c377f tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:23.680323 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-beb64ed6-06f3-49a4-82b2-f16c940c377f tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:23.744445 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-beb64ed6-06f3-49a4-82b2-f16c940c377f tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:21:23.752779 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-beb64ed6-06f3-49a4-82b2-f16c940c377f tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1195 microversion: 2.1 time: 0.088603 Feb 09 13:21:23.752972 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 501/1020] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:21:23 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1195 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:21:24.769079 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-c3124925-e7f7-4789-941f-1420f58b8e92 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:21:24.769699 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-c3124925-e7f7-4789-941f-1420f58b8e92 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:21:24.776035 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c3124925-e7f7-4789-941f-1420f58b8e92 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:24.776495 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c3124925-e7f7-4789-941f-1420f58b8e92 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:24.777325 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c3124925-e7f7-4789-941f-1420f58b8e92 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:24.777770 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c3124925-e7f7-4789-941f-1420f58b8e92 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:24.940408 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-c3124925-e7f7-4789-941f-1420f58b8e92 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:21:24.948232 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-c3124925-e7f7-4789-941f-1420f58b8e92 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1271 microversion: 2.1 time: 0.182961 Feb 09 13:21:24.959454 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 520/1021] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:21:24 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1271 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:21:25.187767 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-f0a31a90-ec8f-4639-8bab-9e4def4b0191 req-cbd606f0-4683-4ea2-8fa5-b974abe0c25e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1603b23-7837-41b5-b502-af4dc9a66c94", "tag": "1c03d285-4ab1-4f1e-af2c-efca29aa27c4"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:21:25.190181 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:21:25.190181 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:21:25.199593 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-f0a31a90-ec8f-4639-8bab-9e4def4b0191 req-cbd606f0-4683-4ea2-8fa5-b974abe0c25e service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:25.200169 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-f0a31a90-ec8f-4639-8bab-9e4def4b0191 req-cbd606f0-4683-4ea2-8fa5-b974abe0c25e service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:25.219771 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-f0a31a90-ec8f-4639-8bab-9e4def4b0191 req-cbd606f0-4683-4ea2-8fa5-b974abe0c25e service nova] Creating event network-changed:1c03d285-4ab1-4f1e-af2c-efca29aa27c4 for instance e1603b23-7837-41b5-b502-af4dc9a66c94 on hv-cinder-82786 Feb 09 13:21:25.224962 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-f0a31a90-ec8f-4639-8bab-9e4def4b0191 req-cbd606f0-4683-4ea2-8fa5-b974abe0c25e service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041471 Feb 09 13:21:25.225553 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 502/1022] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:21:25.967246 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-b2641e20-b016-4def-a6be-c19f5beeded7 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:21:25.967868 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-b2641e20-b016-4def-a6be-c19f5beeded7 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:21:25.973587 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b2641e20-b016-4def-a6be-c19f5beeded7 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:25.974040 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b2641e20-b016-4def-a6be-c19f5beeded7 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:25.974851 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b2641e20-b016-4def-a6be-c19f5beeded7 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:25.975291 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-b2641e20-b016-4def-a6be-c19f5beeded7 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:26.114034 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-b2641e20-b016-4def-a6be-c19f5beeded7 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:21:26.122536 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-b2641e20-b016-4def-a6be-c19f5beeded7 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1259 microversion: 2.1 time: 0.159806 Feb 09 13:21:26.123135 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 521/1023] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:21:25 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:21:27.144699 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8ced1b78-7a7e-4502-9c37-1a41874ebb4b tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:21:27.145325 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8ced1b78-7a7e-4502-9c37-1a41874ebb4b tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:21:27.151606 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8ced1b78-7a7e-4502-9c37-1a41874ebb4b tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:27.152065 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8ced1b78-7a7e-4502-9c37-1a41874ebb4b tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:27.152857 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8ced1b78-7a7e-4502-9c37-1a41874ebb4b tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:27.153301 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8ced1b78-7a7e-4502-9c37-1a41874ebb4b tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:27.287060 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8ced1b78-7a7e-4502-9c37-1a41874ebb4b tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:21:27.294586 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8ced1b78-7a7e-4502-9c37-1a41874ebb4b tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1259 microversion: 2.1 time: 0.154085 Feb 09 13:21:27.295159 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 503/1024] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:21:27 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:21:28.311198 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d856d412-34ee-45eb-b10f-ca1b417e1285 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:21:28.311844 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d856d412-34ee-45eb-b10f-ca1b417e1285 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:21:28.318165 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d856d412-34ee-45eb-b10f-ca1b417e1285 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:28.318657 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d856d412-34ee-45eb-b10f-ca1b417e1285 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:28.319446 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d856d412-34ee-45eb-b10f-ca1b417e1285 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:28.319888 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d856d412-34ee-45eb-b10f-ca1b417e1285 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:28.453152 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d856d412-34ee-45eb-b10f-ca1b417e1285 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:21:28.460513 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d856d412-34ee-45eb-b10f-ca1b417e1285 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1259 microversion: 2.1 time: 0.153009 Feb 09 13:21:28.461083 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 522/1025] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:21:28 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:21:29.477741 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-79e206f3-a4b4-4a02-95bd-bb8e14e85505 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:21:29.478358 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-79e206f3-a4b4-4a02-95bd-bb8e14e85505 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:21:29.484715 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-79e206f3-a4b4-4a02-95bd-bb8e14e85505 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:29.485175 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-79e206f3-a4b4-4a02-95bd-bb8e14e85505 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:29.485979 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-79e206f3-a4b4-4a02-95bd-bb8e14e85505 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:29.486429 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-79e206f3-a4b4-4a02-95bd-bb8e14e85505 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:29.645247 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-79e206f3-a4b4-4a02-95bd-bb8e14e85505 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:21:29.652913 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-79e206f3-a4b4-4a02-95bd-bb8e14e85505 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1259 microversion: 2.1 time: 0.178916 Feb 09 13:21:29.653490 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 504/1026] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:21:29 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:21:30.669135 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-91a473eb-6c36-4839-9073-22d1f94a7ae5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:21:30.670324 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-91a473eb-6c36-4839-9073-22d1f94a7ae5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:21:30.676579 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-91a473eb-6c36-4839-9073-22d1f94a7ae5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:30.677024 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-91a473eb-6c36-4839-9073-22d1f94a7ae5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:30.677802 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-91a473eb-6c36-4839-9073-22d1f94a7ae5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:30.678235 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-91a473eb-6c36-4839-9073-22d1f94a7ae5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:30.813389 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-91a473eb-6c36-4839-9073-22d1f94a7ae5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:21:30.820549 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-91a473eb-6c36-4839-9073-22d1f94a7ae5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1259 microversion: 2.1 time: 0.155433 Feb 09 13:21:30.821107 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 523/1027] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:21:30 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:21:31.836933 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-da920e75-d8eb-4fec-a67d-878abf7fecf5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:21:31.837538 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-da920e75-d8eb-4fec-a67d-878abf7fecf5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:21:31.844453 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-da920e75-d8eb-4fec-a67d-878abf7fecf5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:31.847049 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-da920e75-d8eb-4fec-a67d-878abf7fecf5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:31.847049 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-da920e75-d8eb-4fec-a67d-878abf7fecf5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:31.847049 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-da920e75-d8eb-4fec-a67d-878abf7fecf5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:31.982331 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-da920e75-d8eb-4fec-a67d-878abf7fecf5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:21:31.989635 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-da920e75-d8eb-4fec-a67d-878abf7fecf5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1259 microversion: 2.1 time: 0.156478 Feb 09 13:21:31.990194 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 505/1028] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:21:31 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:21:33.005977 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-e4343217-96cc-4557-8263-5c40d74b9319 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:21:33.006615 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-e4343217-96cc-4557-8263-5c40d74b9319 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:21:33.012882 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e4343217-96cc-4557-8263-5c40d74b9319 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:33.013338 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e4343217-96cc-4557-8263-5c40d74b9319 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:33.014142 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e4343217-96cc-4557-8263-5c40d74b9319 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:33.014602 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e4343217-96cc-4557-8263-5c40d74b9319 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:33.150814 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e4343217-96cc-4557-8263-5c40d74b9319 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:21:33.159052 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-e4343217-96cc-4557-8263-5c40d74b9319 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1259 microversion: 2.1 time: 0.156690 Feb 09 13:21:33.159627 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 524/1029] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:21:33 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:21:34.175942 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-1875968c-6c74-4bb7-8e54-3d5ccc6aa1f5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:21:34.176582 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-1875968c-6c74-4bb7-8e54-3d5ccc6aa1f5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:21:34.182781 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1875968c-6c74-4bb7-8e54-3d5ccc6aa1f5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:34.183240 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1875968c-6c74-4bb7-8e54-3d5ccc6aa1f5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:34.184036 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1875968c-6c74-4bb7-8e54-3d5ccc6aa1f5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:34.184483 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-1875968c-6c74-4bb7-8e54-3d5ccc6aa1f5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:34.319150 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-1875968c-6c74-4bb7-8e54-3d5ccc6aa1f5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:21:34.326428 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-1875968c-6c74-4bb7-8e54-3d5ccc6aa1f5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1259 microversion: 2.1 time: 0.154304 Feb 09 13:21:34.327015 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 506/1030] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:21:34 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:21:35.342298 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-bf2ad7f4-5426-4621-96ca-e912dbdebfd5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:21:35.343068 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-bf2ad7f4-5426-4621-96ca-e912dbdebfd5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:21:35.349366 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bf2ad7f4-5426-4621-96ca-e912dbdebfd5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:35.349812 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bf2ad7f4-5426-4621-96ca-e912dbdebfd5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:35.350619 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bf2ad7f4-5426-4621-96ca-e912dbdebfd5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:35.351056 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bf2ad7f4-5426-4621-96ca-e912dbdebfd5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:35.484731 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-bf2ad7f4-5426-4621-96ca-e912dbdebfd5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:21:35.491941 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-bf2ad7f4-5426-4621-96ca-e912dbdebfd5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1259 microversion: 2.1 time: 0.153864 Feb 09 13:21:35.492511 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 525/1031] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:21:35 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:21:35.839929 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-1adf03a4-0b0e-4bad-92de-eb262a73abd0 req-b7aa3486-3351-49f8-a0f0-cfb5b4ae2ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1603b23-7837-41b5-b502-af4dc9a66c94", "name": "network-vif-plugged", "status": "completed", "tag": "1c03d285-4ab1-4f1e-af2c-efca29aa27c4"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:21:35.841491 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:21:35.841491 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:21:35.848688 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-1adf03a4-0b0e-4bad-92de-eb262a73abd0 req-b7aa3486-3351-49f8-a0f0-cfb5b4ae2ba1 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:35.849136 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-1adf03a4-0b0e-4bad-92de-eb262a73abd0 req-b7aa3486-3351-49f8-a0f0-cfb5b4ae2ba1 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:35.860201 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-1adf03a4-0b0e-4bad-92de-eb262a73abd0 req-b7aa3486-3351-49f8-a0f0-cfb5b4ae2ba1 service nova] Creating event network-vif-plugged:1c03d285-4ab1-4f1e-af2c-efca29aa27c4 for instance e1603b23-7837-41b5-b502-af4dc9a66c94 on hv-cinder-82786 Feb 09 13:21:35.865334 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-1adf03a4-0b0e-4bad-92de-eb262a73abd0 req-b7aa3486-3351-49f8-a0f0-cfb5b4ae2ba1 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029075 Feb 09 13:21:35.868655 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 507/1032] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:21:36.508841 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-c863a399-77df-4587-bc22-7500b3600706 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:21:36.509380 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-c863a399-77df-4587-bc22-7500b3600706 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:21:36.515714 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c863a399-77df-4587-bc22-7500b3600706 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:36.516162 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c863a399-77df-4587-bc22-7500b3600706 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:36.516941 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c863a399-77df-4587-bc22-7500b3600706 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:36.517376 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-c863a399-77df-4587-bc22-7500b3600706 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:36.652207 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-c863a399-77df-4587-bc22-7500b3600706 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:21:36.660323 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-c863a399-77df-4587-bc22-7500b3600706 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1259 microversion: 2.1 time: 0.155209 Feb 09 13:21:36.660893 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 526/1033] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:21:36 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:21:37.678391 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-3dccdb49-3853-4a7a-acec-a68a2aeeb96e tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:21:37.679117 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-3dccdb49-3853-4a7a-acec-a68a2aeeb96e tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:21:37.685650 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3dccdb49-3853-4a7a-acec-a68a2aeeb96e tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:37.686101 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3dccdb49-3853-4a7a-acec-a68a2aeeb96e tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:37.686906 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3dccdb49-3853-4a7a-acec-a68a2aeeb96e tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:37.687343 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3dccdb49-3853-4a7a-acec-a68a2aeeb96e tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:37.820884 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3dccdb49-3853-4a7a-acec-a68a2aeeb96e tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:21:37.828408 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-3dccdb49-3853-4a7a-acec-a68a2aeeb96e tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1443 microversion: 2.1 time: 0.154559 Feb 09 13:21:37.830643 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 508/1034] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:21:37 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:21:37.843962 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-27252cd1-d046-4497-8a9b-113415b5465f tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:21:37.844586 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-27252cd1-d046-4497-8a9b-113415b5465f tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:21:37.850874 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-27252cd1-d046-4497-8a9b-113415b5465f tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:37.853560 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-27252cd1-d046-4497-8a9b-113415b5465f tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:37.853560 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-27252cd1-d046-4497-8a9b-113415b5465f tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:37.853560 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-27252cd1-d046-4497-8a9b-113415b5465f tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:37.985870 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-27252cd1-d046-4497-8a9b-113415b5465f tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:21:37.993203 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-27252cd1-d046-4497-8a9b-113415b5465f tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1443 microversion: 2.1 time: 0.152910 Feb 09 13:21:37.993779 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 527/1035] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:21:37 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:21:39.947219 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-356e99e0-17b8-44c8-9ea7-c707aa9cf8df req-717732d3-31dc-474e-a009-0bc3c387d3c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1603b23-7837-41b5-b502-af4dc9a66c94", "tag": "1c03d285-4ab1-4f1e-af2c-efca29aa27c4"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:21:39.949074 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:21:39.949074 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:21:39.956935 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-356e99e0-17b8-44c8-9ea7-c707aa9cf8df req-717732d3-31dc-474e-a009-0bc3c387d3c9 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:21:39.958068 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-356e99e0-17b8-44c8-9ea7-c707aa9cf8df req-717732d3-31dc-474e-a009-0bc3c387d3c9 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:21:39.968648 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-356e99e0-17b8-44c8-9ea7-c707aa9cf8df req-717732d3-31dc-474e-a009-0bc3c387d3c9 service nova] Creating event network-changed:1c03d285-4ab1-4f1e-af2c-efca29aa27c4 for instance e1603b23-7837-41b5-b502-af4dc9a66c94 on hv-cinder-82786 Feb 09 13:21:39.973732 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-356e99e0-17b8-44c8-9ea7-c707aa9cf8df req-717732d3-31dc-474e-a009-0bc3c387d3c9 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030268 Feb 09 13:21:39.974403 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 509/1036] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:22:14.808195 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-f405bee1-290f-467d-9826-158820576ea9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1678932028", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-423323945", "security_groups": [{"name": "tempest-secgroup-smoke-147747940"}], "block_device_mapping_v2": [{"uuid": "a15342f7-8631-49f9-8199-bf51615e1e08", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05ef35c6-6e26-4081-883e-e7a7d012ab72"}]}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:22:14.918273 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.network.neutron [None req-f405bee1-290f-467d-9826-158820576ea9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] validate_networks() for [('05ef35c6-6e26-4081-883e-e7a7d012ab72', None, None, None, None, None)] {{(pid=116748) validate_networks /opt/stack/nova/nova/network/neutron.py:2554}} Feb 09 13:22:15.275877 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-f405bee1-290f-467d-9826-158820576ea9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Flavor limits 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 09 13:22:15.276306 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-f405bee1-290f-467d-9826-158820576ea9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Image limits 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 09 13:22:15.276790 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-f405bee1-290f-467d-9826-158820576ea9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Flavor pref 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 09 13:22:15.277206 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-f405bee1-290f-467d-9826-158820576ea9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Image pref 0:0:0 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 09 13:22:15.277622 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.virt.hardware [None req-f405bee1-290f-467d-9826-158820576ea9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 09 13:22:15.286919 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f405bee1-290f-467d-9826-158820576ea9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:15.287377 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f405bee1-290f-467d-9826-158820576ea9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:15.288203 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f405bee1-290f-467d-9826-158820576ea9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:15.288644 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f405bee1-290f-467d-9826-158820576ea9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:15.305463 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-f405bee1-290f-467d-9826-158820576ea9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Getting quotas for project d5ef8e70a161475ab7130108627df2e4. Resources: {'instances', 'cores', 'ram'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 09 13:22:15.309144 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.quota [None req-f405bee1-290f-467d-9826-158820576ea9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Getting quotas for user 11b331092b7645388e37636426326374 and project d5ef8e70a161475ab7130108627df2e4. Resources: {'instances', 'cores', 'ram'} {{(pid=116748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 09 13:22:15.363143 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-f405bee1-290f-467d-9826-158820576ea9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Going to run 1 instances... {{(pid=116748) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 09 13:22:15.365169 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-f405bee1-290f-467d-9826-158820576ea9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a15342f7-8631-49f9-8199-bf51615e1e08',volume_size=None,volume_type=None)] {{(pid=116748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 09 13:22:15.752312 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-f405bee1-290f-467d-9826-158820576ea9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.947968 Feb 09 13:22:15.752951 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 528/1037] 10.222.0.84 () {60 vars in 1146 bytes} [Wed Feb 9 13:22:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 09 13:22:15.764477 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ebe113a2-41fa-4c24-840e-6f6fd008d1c1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:22:15.765165 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-ebe113a2-41fa-4c24-840e-6f6fd008d1c1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:22:15.819215 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ebe113a2-41fa-4c24-840e-6f6fd008d1c1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:22:15.826376 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-ebe113a2-41fa-4c24-840e-6f6fd008d1c1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d" status: 200 len: 1094 microversion: 2.1 time: 0.066350 Feb 09 13:22:15.826976 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 510/1038] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:22:15 2022] GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:22:16.845170 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-dd4b9597-37e2-440e-9498-1d250512c9fe tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:22:16.845898 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-dd4b9597-37e2-440e-9498-1d250512c9fe tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:22:16.853054 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-dd4b9597-37e2-440e-9498-1d250512c9fe tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:16.853576 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-dd4b9597-37e2-440e-9498-1d250512c9fe tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:16.854476 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-dd4b9597-37e2-440e-9498-1d250512c9fe tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:16.855059 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-dd4b9597-37e2-440e-9498-1d250512c9fe tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:16.921453 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-dd4b9597-37e2-440e-9498-1d250512c9fe tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:22:16.929840 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-dd4b9597-37e2-440e-9498-1d250512c9fe tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d" status: 200 len: 1144 microversion: 2.1 time: 0.090151 Feb 09 13:22:16.930481 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 529/1039] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:22:16 2022] GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:22:17.948121 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d2e9af2a-1ecb-452c-ac73-3e5b1be39cc2 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:22:17.948854 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d2e9af2a-1ecb-452c-ac73-3e5b1be39cc2 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:22:17.957454 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d2e9af2a-1ecb-452c-ac73-3e5b1be39cc2 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:17.957913 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d2e9af2a-1ecb-452c-ac73-3e5b1be39cc2 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:17.958753 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d2e9af2a-1ecb-452c-ac73-3e5b1be39cc2 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:17.959198 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d2e9af2a-1ecb-452c-ac73-3e5b1be39cc2 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:18.286086 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-d2e9af2a-1ecb-452c-ac73-3e5b1be39cc2 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:22:18.293594 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d2e9af2a-1ecb-452c-ac73-3e5b1be39cc2 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d" status: 200 len: 1200 microversion: 2.1 time: 0.349430 Feb 09 13:22:18.294261 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 511/1040] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:22:17 2022] GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d => generated 1200 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:22:19.311167 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-8301f9ab-d743-444d-8c7b-8abd4307fdda tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:22:19.311827 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-8301f9ab-d743-444d-8c7b-8abd4307fdda tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:22:19.318224 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8301f9ab-d743-444d-8c7b-8abd4307fdda tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:19.318795 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8301f9ab-d743-444d-8c7b-8abd4307fdda tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:19.319553 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8301f9ab-d743-444d-8c7b-8abd4307fdda tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:19.320003 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-8301f9ab-d743-444d-8c7b-8abd4307fdda tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:19.455855 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-8301f9ab-d743-444d-8c7b-8abd4307fdda tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:22:19.464636 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-8301f9ab-d743-444d-8c7b-8abd4307fdda tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d" status: 200 len: 1265 microversion: 2.1 time: 0.157224 Feb 09 13:22:19.465234 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 530/1041] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:22:19 2022] GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:22:19.843949 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-8c66a84d-6879-4c94-be3a-1b0591217f07 req-70ac7d55-7ec0-4923-b640-be47a7139a46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ce4c8e-d560-4c3b-8929-1f125064ac2d", "tag": "2a571256-0a84-4e0f-ad42-d0f61dbe95c1"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:22:19.845530 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:22:19.845530 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:22:19.853197 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-8c66a84d-6879-4c94-be3a-1b0591217f07 req-70ac7d55-7ec0-4923-b640-be47a7139a46 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:19.853938 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-8c66a84d-6879-4c94-be3a-1b0591217f07 req-70ac7d55-7ec0-4923-b640-be47a7139a46 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:19.866043 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-8c66a84d-6879-4c94-be3a-1b0591217f07 req-70ac7d55-7ec0-4923-b640-be47a7139a46 service nova] Creating event network-changed:2a571256-0a84-4e0f-ad42-d0f61dbe95c1 for instance f1ce4c8e-d560-4c3b-8929-1f125064ac2d on hv-cinder-82786 Feb 09 13:22:19.871189 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-8c66a84d-6879-4c94-be3a-1b0591217f07 req-70ac7d55-7ec0-4923-b640-be47a7139a46 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097682 Feb 09 13:22:19.872330 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 512/1042] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:22:20.482029 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-647c5629-3128-4e56-988a-d969d1d0182d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:22:20.482829 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-647c5629-3128-4e56-988a-d969d1d0182d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:22:20.489698 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-647c5629-3128-4e56-988a-d969d1d0182d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:20.490152 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-647c5629-3128-4e56-988a-d969d1d0182d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:20.490979 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-647c5629-3128-4e56-988a-d969d1d0182d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:20.491422 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-647c5629-3128-4e56-988a-d969d1d0182d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:20.627899 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-647c5629-3128-4e56-988a-d969d1d0182d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:22:20.635319 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-647c5629-3128-4e56-988a-d969d1d0182d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d" status: 200 len: 1265 microversion: 2.1 time: 0.157275 Feb 09 13:22:20.636111 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 531/1043] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:22:20 2022] GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:22:21.653645 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8e3a53c7-f2e1-4871-becc-8dd661aa5d7f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:22:21.654259 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8e3a53c7-f2e1-4871-becc-8dd661aa5d7f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:22:21.661127 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8e3a53c7-f2e1-4871-becc-8dd661aa5d7f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:21.661591 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8e3a53c7-f2e1-4871-becc-8dd661aa5d7f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:21.662377 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8e3a53c7-f2e1-4871-becc-8dd661aa5d7f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:21.662845 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8e3a53c7-f2e1-4871-becc-8dd661aa5d7f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:21.796046 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8e3a53c7-f2e1-4871-becc-8dd661aa5d7f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:22:21.803307 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8e3a53c7-f2e1-4871-becc-8dd661aa5d7f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d" status: 200 len: 1265 microversion: 2.1 time: 0.154238 Feb 09 13:22:21.803873 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 513/1044] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:22:21 2022] GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:22:22.820095 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-bcc8f39d-150b-45f4-a8e9-1a8a505b49ff tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:22:22.820737 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-bcc8f39d-150b-45f4-a8e9-1a8a505b49ff tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:22:22.827824 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bcc8f39d-150b-45f4-a8e9-1a8a505b49ff tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:22.828271 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bcc8f39d-150b-45f4-a8e9-1a8a505b49ff tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:22.829053 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bcc8f39d-150b-45f4-a8e9-1a8a505b49ff tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:22.829484 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bcc8f39d-150b-45f4-a8e9-1a8a505b49ff tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:22.961399 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-bcc8f39d-150b-45f4-a8e9-1a8a505b49ff tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:22:22.969401 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-bcc8f39d-150b-45f4-a8e9-1a8a505b49ff tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d" status: 200 len: 1265 microversion: 2.1 time: 0.153038 Feb 09 13:22:22.969982 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 532/1045] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:22:22 2022] GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:22:23.986190 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d54cbac1-b66e-4bc3-b9c1-aaada959026d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:22:23.986833 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d54cbac1-b66e-4bc3-b9c1-aaada959026d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:22:23.993305 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d54cbac1-b66e-4bc3-b9c1-aaada959026d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:23.993759 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d54cbac1-b66e-4bc3-b9c1-aaada959026d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:23.994604 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d54cbac1-b66e-4bc3-b9c1-aaada959026d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:23.995046 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d54cbac1-b66e-4bc3-b9c1-aaada959026d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:24.132471 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-d54cbac1-b66e-4bc3-b9c1-aaada959026d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:22:24.140278 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d54cbac1-b66e-4bc3-b9c1-aaada959026d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d" status: 200 len: 1265 microversion: 2.1 time: 0.157841 Feb 09 13:22:24.140841 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 514/1046] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:22:23 2022] GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:22:25.157840 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-193d9b79-8922-4fbd-a420-a0649bcbba9d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:22:25.158407 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-193d9b79-8922-4fbd-a420-a0649bcbba9d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:22:25.164827 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-193d9b79-8922-4fbd-a420-a0649bcbba9d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:25.165283 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-193d9b79-8922-4fbd-a420-a0649bcbba9d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:25.166073 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-193d9b79-8922-4fbd-a420-a0649bcbba9d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:25.166521 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-193d9b79-8922-4fbd-a420-a0649bcbba9d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:25.301772 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-193d9b79-8922-4fbd-a420-a0649bcbba9d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:22:25.309132 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-193d9b79-8922-4fbd-a420-a0649bcbba9d tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d" status: 200 len: 1265 microversion: 2.1 time: 0.156064 Feb 09 13:22:25.309706 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 533/1047] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:22:25 2022] GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:22:26.325011 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8ce0410a-f3f6-481d-a72a-400fd69b21eb tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:22:26.325653 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8ce0410a-f3f6-481d-a72a-400fd69b21eb tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:22:26.331894 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8ce0410a-f3f6-481d-a72a-400fd69b21eb tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:26.332349 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8ce0410a-f3f6-481d-a72a-400fd69b21eb tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:26.333136 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8ce0410a-f3f6-481d-a72a-400fd69b21eb tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:26.333577 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8ce0410a-f3f6-481d-a72a-400fd69b21eb tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:26.465655 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8ce0410a-f3f6-481d-a72a-400fd69b21eb tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:22:26.473422 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8ce0410a-f3f6-481d-a72a-400fd69b21eb tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d" status: 200 len: 1265 microversion: 2.1 time: 0.152083 Feb 09 13:22:26.473992 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 515/1048] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:22:26 2022] GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:22:27.490399 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-335561ca-e5cf-41d1-9f37-90376f05fca0 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:22:27.491040 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-335561ca-e5cf-41d1-9f37-90376f05fca0 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:22:27.497080 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-335561ca-e5cf-41d1-9f37-90376f05fca0 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:27.497539 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-335561ca-e5cf-41d1-9f37-90376f05fca0 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:27.498333 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-335561ca-e5cf-41d1-9f37-90376f05fca0 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:27.498810 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-335561ca-e5cf-41d1-9f37-90376f05fca0 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:27.638579 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-335561ca-e5cf-41d1-9f37-90376f05fca0 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:22:27.646745 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-335561ca-e5cf-41d1-9f37-90376f05fca0 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d" status: 200 len: 1265 microversion: 2.1 time: 0.160033 Feb 09 13:22:27.647316 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 534/1049] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:22:27 2022] GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:22:28.665530 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-963fcfe4-e707-45a6-b1b6-3be05258998e tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:22:28.666147 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-963fcfe4-e707-45a6-b1b6-3be05258998e tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:22:28.672443 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-963fcfe4-e707-45a6-b1b6-3be05258998e tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:28.672891 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-963fcfe4-e707-45a6-b1b6-3be05258998e tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:28.673685 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-963fcfe4-e707-45a6-b1b6-3be05258998e tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:28.674125 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-963fcfe4-e707-45a6-b1b6-3be05258998e tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:28.884114 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-963fcfe4-e707-45a6-b1b6-3be05258998e tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:22:28.892064 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-963fcfe4-e707-45a6-b1b6-3be05258998e tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d" status: 200 len: 1265 microversion: 2.1 time: 0.230600 Feb 09 13:22:28.892626 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 516/1050] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:22:28 2022] GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:22:29.909265 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-3a34bc21-4078-4177-8fdb-4d124a22074f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:22:29.909879 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-3a34bc21-4078-4177-8fdb-4d124a22074f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:22:29.916130 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3a34bc21-4078-4177-8fdb-4d124a22074f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:29.916590 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3a34bc21-4078-4177-8fdb-4d124a22074f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:29.917381 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3a34bc21-4078-4177-8fdb-4d124a22074f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:29.917826 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3a34bc21-4078-4177-8fdb-4d124a22074f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:30.059144 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-3a34bc21-4078-4177-8fdb-4d124a22074f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:22:30.066479 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-3a34bc21-4078-4177-8fdb-4d124a22074f tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d" status: 200 len: 1265 microversion: 2.1 time: 0.161691 Feb 09 13:22:30.067082 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 535/1051] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:22:29 2022] GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:22:30.090074 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-ce583f13-fdee-412e-bb02-bfa694cae8d5 req-bbb9f749-00fc-4df9-bc6d-c3c56f385386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ce4c8e-d560-4c3b-8929-1f125064ac2d", "name": "network-vif-plugged", "status": "completed", "tag": "2a571256-0a84-4e0f-ad42-d0f61dbe95c1"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:22:30.095468 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:22:30.095468 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:22:30.099528 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-ce583f13-fdee-412e-bb02-bfa694cae8d5 req-bbb9f749-00fc-4df9-bc6d-c3c56f385386 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:30.099967 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-ce583f13-fdee-412e-bb02-bfa694cae8d5 req-bbb9f749-00fc-4df9-bc6d-c3c56f385386 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:30.111061 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-ce583f13-fdee-412e-bb02-bfa694cae8d5 req-bbb9f749-00fc-4df9-bc6d-c3c56f385386 service nova] Creating event network-vif-plugged:2a571256-0a84-4e0f-ad42-d0f61dbe95c1 for instance f1ce4c8e-d560-4c3b-8929-1f125064ac2d on hv-cinder-82786 Feb 09 13:22:30.116284 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-ce583f13-fdee-412e-bb02-bfa694cae8d5 req-bbb9f749-00fc-4df9-bc6d-c3c56f385386 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029914 Feb 09 13:22:30.116866 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 517/1052] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:22:31.083028 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-3d92ce05-5a4a-463b-b9d0-dff41736f6ee tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:22:31.083641 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-3d92ce05-5a4a-463b-b9d0-dff41736f6ee tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:22:31.089853 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3d92ce05-5a4a-463b-b9d0-dff41736f6ee tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:31.090358 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3d92ce05-5a4a-463b-b9d0-dff41736f6ee tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:31.091506 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3d92ce05-5a4a-463b-b9d0-dff41736f6ee tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:31.092201 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3d92ce05-5a4a-463b-b9d0-dff41736f6ee tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:31.239057 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-3d92ce05-5a4a-463b-b9d0-dff41736f6ee tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:22:31.246813 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-3d92ce05-5a4a-463b-b9d0-dff41736f6ee tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d" status: 200 len: 1265 microversion: 2.1 time: 0.167499 Feb 09 13:22:31.247392 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 536/1053] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:22:31 2022] GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:22:32.264076 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-dd5aa230-42bc-45e2-a5ce-a56f536db4a9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:22:32.264784 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-dd5aa230-42bc-45e2-a5ce-a56f536db4a9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:22:32.271296 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-dd5aa230-42bc-45e2-a5ce-a56f536db4a9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:32.271752 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-dd5aa230-42bc-45e2-a5ce-a56f536db4a9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:32.272565 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-dd5aa230-42bc-45e2-a5ce-a56f536db4a9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:32.273008 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-dd5aa230-42bc-45e2-a5ce-a56f536db4a9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:32.409500 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-dd5aa230-42bc-45e2-a5ce-a56f536db4a9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:22:32.416752 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-dd5aa230-42bc-45e2-a5ce-a56f536db4a9 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d" status: 200 len: 1452 microversion: 2.1 time: 0.156754 Feb 09 13:22:32.417312 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 518/1054] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:22:32 2022] GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:22:32.432803 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-3bc5c927-1a44-4f4c-9a68-2d0b815a6769 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:22:32.433418 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-3bc5c927-1a44-4f4c-9a68-2d0b815a6769 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:22:32.440225 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3bc5c927-1a44-4f4c-9a68-2d0b815a6769 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:32.440680 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3bc5c927-1a44-4f4c-9a68-2d0b815a6769 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:32.441496 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3bc5c927-1a44-4f4c-9a68-2d0b815a6769 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:32.441938 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-3bc5c927-1a44-4f4c-9a68-2d0b815a6769 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:32.579661 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-3bc5c927-1a44-4f4c-9a68-2d0b815a6769 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:22:32.586891 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-3bc5c927-1a44-4f4c-9a68-2d0b815a6769 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d" status: 200 len: 1452 microversion: 2.1 time: 0.157723 Feb 09 13:22:32.587464 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 537/1055] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:22:32 2022] GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:22:34.704588 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-5ebd251b-7ed0-429c-8831-323f23287293 req-2177ea3f-f2eb-40d6-9636-bab33458eaf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ce4c8e-d560-4c3b-8929-1f125064ac2d", "tag": "2a571256-0a84-4e0f-ad42-d0f61dbe95c1"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:22:34.706091 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:22:34.706091 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:22:34.712756 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-5ebd251b-7ed0-429c-8831-323f23287293 req-2177ea3f-f2eb-40d6-9636-bab33458eaf8 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:22:34.713196 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-5ebd251b-7ed0-429c-8831-323f23287293 req-2177ea3f-f2eb-40d6-9636-bab33458eaf8 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:22:34.723509 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-5ebd251b-7ed0-429c-8831-323f23287293 req-2177ea3f-f2eb-40d6-9636-bab33458eaf8 service nova] Creating event network-changed:2a571256-0a84-4e0f-ad42-d0f61dbe95c1 for instance f1ce4c8e-d560-4c3b-8929-1f125064ac2d on hv-cinder-82786 Feb 09 13:22:34.728686 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-5ebd251b-7ed0-429c-8831-323f23287293 req-2177ea3f-f2eb-40d6-9636-bab33458eaf8 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082300 Feb 09 13:22:34.729276 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 519/1056] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:22:58.779324 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 09 13:22:58.779890 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: Wed Feb 9 13:22:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 09 13:23:23.777503 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 09 13:23:23.778324 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: Wed Feb 9 13:23:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 09 13:23:45.359224 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-749050f4-9adb-42da-a390-6e6230c79fc6 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:23:45.359841 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-749050f4-9adb-42da-a390-6e6230c79fc6 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:23:45.365586 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-749050f4-9adb-42da-a390-6e6230c79fc6 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:45.366034 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-749050f4-9adb-42da-a390-6e6230c79fc6 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:45.366848 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-749050f4-9adb-42da-a390-6e6230c79fc6 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:45.367288 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-749050f4-9adb-42da-a390-6e6230c79fc6 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:45.389323 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-749050f4-9adb-42da-a390-6e6230c79fc6 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lazy-loading 'flavor' on Instance uuid e1603b23-7837-41b5-b502-af4dc9a66c94 {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:23:45.647045 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-749050f4-9adb-42da-a390-6e6230c79fc6 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "POST /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94/action" status: 202 len: 0 microversion: 2.1 time: 0.292748 Feb 09 13:23:45.647560 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 538/1057] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Feb 9 13:23:45 2022] POST /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 09 13:23:45.657236 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-3ef114d8-b598-47b8-94a0-6761bb68171e tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:23:45.658274 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-3ef114d8-b598-47b8-94a0-6761bb68171e tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:23:45.665133 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3ef114d8-b598-47b8-94a0-6761bb68171e tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:45.665667 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3ef114d8-b598-47b8-94a0-6761bb68171e tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:45.666446 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3ef114d8-b598-47b8-94a0-6761bb68171e tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:45.666915 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-3ef114d8-b598-47b8-94a0-6761bb68171e tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:45.809644 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-3ef114d8-b598-47b8-94a0-6761bb68171e tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:23:45.817406 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-3ef114d8-b598-47b8-94a0-6761bb68171e tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1568 microversion: 2.1 time: 0.165415 Feb 09 13:23:45.817968 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 520/1058] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:23:45 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:23:46.835682 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-83ed26d8-6a02-46c0-9120-b6f478a2775c tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:23:46.836386 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-83ed26d8-6a02-46c0-9120-b6f478a2775c tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:23:46.842454 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-83ed26d8-6a02-46c0-9120-b6f478a2775c tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:46.842941 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-83ed26d8-6a02-46c0-9120-b6f478a2775c tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:46.843733 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-83ed26d8-6a02-46c0-9120-b6f478a2775c tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:46.844171 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-83ed26d8-6a02-46c0-9120-b6f478a2775c tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:46.985436 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-83ed26d8-6a02-46c0-9120-b6f478a2775c tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:23:46.992839 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-83ed26d8-6a02-46c0-9120-b6f478a2775c tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1568 microversion: 2.1 time: 0.161834 Feb 09 13:23:46.993403 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 539/1059] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:23:46 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:23:48.010193 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-848daddb-6098-4335-944c-a78b9eba9a56 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:23:48.010831 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-848daddb-6098-4335-944c-a78b9eba9a56 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:23:48.017689 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-848daddb-6098-4335-944c-a78b9eba9a56 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:48.018199 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-848daddb-6098-4335-944c-a78b9eba9a56 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:48.019041 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-848daddb-6098-4335-944c-a78b9eba9a56 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:48.019482 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-848daddb-6098-4335-944c-a78b9eba9a56 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:48.152680 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-848daddb-6098-4335-944c-a78b9eba9a56 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:23:48.160519 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-848daddb-6098-4335-944c-a78b9eba9a56 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1568 microversion: 2.1 time: 0.154008 Feb 09 13:23:48.161063 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 521/1060] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:23:48 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:23:49.177276 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d8e92064-db27-4174-826e-b5861daaaabc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:23:49.177832 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d8e92064-db27-4174-826e-b5861daaaabc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:23:49.184817 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d8e92064-db27-4174-826e-b5861daaaabc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:49.185275 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d8e92064-db27-4174-826e-b5861daaaabc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:49.186075 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d8e92064-db27-4174-826e-b5861daaaabc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:49.186512 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d8e92064-db27-4174-826e-b5861daaaabc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:49.331115 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d8e92064-db27-4174-826e-b5861daaaabc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:23:49.338517 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d8e92064-db27-4174-826e-b5861daaaabc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1568 microversion: 2.1 time: 0.165084 Feb 09 13:23:49.339108 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 540/1061] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:23:49 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:23:50.355215 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c5c2061f-bf69-4e9d-a953-0bd788491b30 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:23:50.356340 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-c5c2061f-bf69-4e9d-a953-0bd788491b30 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:23:50.362527 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c5c2061f-bf69-4e9d-a953-0bd788491b30 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:50.363005 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c5c2061f-bf69-4e9d-a953-0bd788491b30 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:50.363786 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c5c2061f-bf69-4e9d-a953-0bd788491b30 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:50.364216 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c5c2061f-bf69-4e9d-a953-0bd788491b30 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:50.497891 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c5c2061f-bf69-4e9d-a953-0bd788491b30 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:23:50.505230 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c5c2061f-bf69-4e9d-a953-0bd788491b30 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1568 microversion: 2.1 time: 0.153787 Feb 09 13:23:50.505820 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 522/1062] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:23:50 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:23:51.521137 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-9245fd9a-bc34-4b7f-bea4-6bd6e85b2a5d tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:23:51.521668 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-9245fd9a-bc34-4b7f-bea4-6bd6e85b2a5d tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:23:51.527909 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9245fd9a-bc34-4b7f-bea4-6bd6e85b2a5d tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:51.528355 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9245fd9a-bc34-4b7f-bea4-6bd6e85b2a5d tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:51.529132 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9245fd9a-bc34-4b7f-bea4-6bd6e85b2a5d tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:51.529562 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9245fd9a-bc34-4b7f-bea4-6bd6e85b2a5d tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:51.669558 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-9245fd9a-bc34-4b7f-bea4-6bd6e85b2a5d tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:23:51.676783 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-9245fd9a-bc34-4b7f-bea4-6bd6e85b2a5d tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1568 microversion: 2.1 time: 0.159432 Feb 09 13:23:51.677352 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 541/1063] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:23:51 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:23:52.694036 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-4909f74f-22aa-451b-8b77-c9b987fc71f5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:23:52.694687 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-4909f74f-22aa-451b-8b77-c9b987fc71f5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:23:52.701382 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4909f74f-22aa-451b-8b77-c9b987fc71f5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:52.701846 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4909f74f-22aa-451b-8b77-c9b987fc71f5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:52.702668 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4909f74f-22aa-451b-8b77-c9b987fc71f5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:52.703106 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-4909f74f-22aa-451b-8b77-c9b987fc71f5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:52.844955 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-4909f74f-22aa-451b-8b77-c9b987fc71f5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:23:52.852281 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-4909f74f-22aa-451b-8b77-c9b987fc71f5 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1568 microversion: 2.1 time: 0.161906 Feb 09 13:23:52.852879 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 523/1064] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:23:52 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:23:53.868776 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-f9238dc2-7657-4c51-88ad-718bf113785a tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:23:53.869390 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-f9238dc2-7657-4c51-88ad-718bf113785a tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:23:53.876025 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f9238dc2-7657-4c51-88ad-718bf113785a tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:53.880939 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f9238dc2-7657-4c51-88ad-718bf113785a tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:53.880939 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f9238dc2-7657-4c51-88ad-718bf113785a tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:53.880939 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f9238dc2-7657-4c51-88ad-718bf113785a tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:54.011350 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f9238dc2-7657-4c51-88ad-718bf113785a tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:23:54.019268 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-f9238dc2-7657-4c51-88ad-718bf113785a tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1568 microversion: 2.1 time: 0.154262 Feb 09 13:23:54.019838 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 542/1065] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:23:53 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:23:55.036893 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-53d6b9bf-a071-4daf-9fd2-71ed5358b7ce tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:23:55.037509 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-53d6b9bf-a071-4daf-9fd2-71ed5358b7ce tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:23:55.044372 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-53d6b9bf-a071-4daf-9fd2-71ed5358b7ce tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:55.044820 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-53d6b9bf-a071-4daf-9fd2-71ed5358b7ce tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:55.045616 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-53d6b9bf-a071-4daf-9fd2-71ed5358b7ce tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:55.046050 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-53d6b9bf-a071-4daf-9fd2-71ed5358b7ce tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:55.179471 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-53d6b9bf-a071-4daf-9fd2-71ed5358b7ce tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:23:55.187039 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-53d6b9bf-a071-4daf-9fd2-71ed5358b7ce tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1568 microversion: 2.1 time: 0.154130 Feb 09 13:23:55.187598 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 524/1066] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:23:55 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:23:56.204295 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-5e9919d9-4249-424c-b565-d4638c9de9ac tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:23:56.204910 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-5e9919d9-4249-424c-b565-d4638c9de9ac tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:23:56.210930 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5e9919d9-4249-424c-b565-d4638c9de9ac tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:56.211385 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5e9919d9-4249-424c-b565-d4638c9de9ac tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:56.212171 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5e9919d9-4249-424c-b565-d4638c9de9ac tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:56.212788 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-5e9919d9-4249-424c-b565-d4638c9de9ac tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:56.351584 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-5e9919d9-4249-424c-b565-d4638c9de9ac tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:23:56.359000 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-5e9919d9-4249-424c-b565-d4638c9de9ac tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1568 microversion: 2.1 time: 0.158508 Feb 09 13:23:56.359798 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 543/1067] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:23:56 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:23:57.376230 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-2054b385-791c-42e3-8b5d-e83a4de9b6d4 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:23:57.376889 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-2054b385-791c-42e3-8b5d-e83a4de9b6d4 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:23:57.382905 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2054b385-791c-42e3-8b5d-e83a4de9b6d4 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:57.383364 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2054b385-791c-42e3-8b5d-e83a4de9b6d4 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:57.384184 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2054b385-791c-42e3-8b5d-e83a4de9b6d4 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:57.384626 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-2054b385-791c-42e3-8b5d-e83a4de9b6d4 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:57.519056 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-2054b385-791c-42e3-8b5d-e83a4de9b6d4 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:23:57.526345 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-2054b385-791c-42e3-8b5d-e83a4de9b6d4 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1568 microversion: 2.1 time: 0.153883 Feb 09 13:23:57.526933 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 525/1068] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:23:57 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:23:58.542566 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-299555cd-f58a-4ae0-9b59-5b711a860dce tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:23:58.543687 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-299555cd-f58a-4ae0-9b59-5b711a860dce tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:23:58.549811 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-299555cd-f58a-4ae0-9b59-5b711a860dce tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:58.550265 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-299555cd-f58a-4ae0-9b59-5b711a860dce tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:58.551076 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-299555cd-f58a-4ae0-9b59-5b711a860dce tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:58.551516 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-299555cd-f58a-4ae0-9b59-5b711a860dce tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:58.686910 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-299555cd-f58a-4ae0-9b59-5b711a860dce tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:23:58.695022 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-299555cd-f58a-4ae0-9b59-5b711a860dce tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1568 microversion: 2.1 time: 0.156124 Feb 09 13:23:58.695590 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 544/1069] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:23:58 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:23:59.712495 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8355efc6-0d37-4c87-bfb5-7cffd7408e58 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:23:59.713207 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8355efc6-0d37-4c87-bfb5-7cffd7408e58 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:23:59.719613 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8355efc6-0d37-4c87-bfb5-7cffd7408e58 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:59.728565 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8355efc6-0d37-4c87-bfb5-7cffd7408e58 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:59.728565 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8355efc6-0d37-4c87-bfb5-7cffd7408e58 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:59.728565 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8355efc6-0d37-4c87-bfb5-7cffd7408e58 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:59.866513 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8355efc6-0d37-4c87-bfb5-7cffd7408e58 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:23:59.873757 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8355efc6-0d37-4c87-bfb5-7cffd7408e58 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1509 microversion: 2.1 time: 0.165576 Feb 09 13:23:59.874318 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 526/1070] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:23:59 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:23:59.889733 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-4b1becbe-695c-42cf-add0-fc02eead95dc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:23:59.890303 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-4b1becbe-695c-42cf-add0-fc02eead95dc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:23:59.896534 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4b1becbe-695c-42cf-add0-fc02eead95dc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:59.896982 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4b1becbe-695c-42cf-add0-fc02eead95dc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:23:59.897750 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4b1becbe-695c-42cf-add0-fc02eead95dc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:23:59.898181 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-4b1becbe-695c-42cf-add0-fc02eead95dc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:00.074771 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-4b1becbe-695c-42cf-add0-fc02eead95dc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "POST /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94/action" status: 202 len: 0 microversion: 2.1 time: 0.187907 Feb 09 13:24:00.075543 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 545/1071] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Feb 9 13:23:59 2022] POST /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:24:00.083558 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-e5acf8be-fa7e-4cc2-a4be-51c1f8f22abd tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:00.084181 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-e5acf8be-fa7e-4cc2-a4be-51c1f8f22abd tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:00.091446 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e5acf8be-fa7e-4cc2-a4be-51c1f8f22abd tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:00.091888 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e5acf8be-fa7e-4cc2-a4be-51c1f8f22abd tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:00.092682 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e5acf8be-fa7e-4cc2-a4be-51c1f8f22abd tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:00.093122 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e5acf8be-fa7e-4cc2-a4be-51c1f8f22abd tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:00.228491 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-e5acf8be-fa7e-4cc2-a4be-51c1f8f22abd tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:24:00.235995 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-e5acf8be-fa7e-4cc2-a4be-51c1f8f22abd tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1517 microversion: 2.1 time: 0.156158 Feb 09 13:24:00.236562 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 527/1072] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:00 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:24:00.553036 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-70cbaf47-f2ec-4949-a9c4-89cd6733f4e8 req-815f9bdd-0283-4b3d-b31d-b17e578affe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1603b23-7837-41b5-b502-af4dc9a66c94", "name": "network-vif-unplugged", "status": "completed", "tag": "1c03d285-4ab1-4f1e-af2c-efca29aa27c4"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:24:00.555404 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:24:00.555404 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:24:00.563423 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-70cbaf47-f2ec-4949-a9c4-89cd6733f4e8 req-815f9bdd-0283-4b3d-b31d-b17e578affe2 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:00.563874 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-70cbaf47-f2ec-4949-a9c4-89cd6733f4e8 req-815f9bdd-0283-4b3d-b31d-b17e578affe2 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:00.576395 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.compute.server_external_events [req-70cbaf47-f2ec-4949-a9c4-89cd6733f4e8 req-815f9bdd-0283-4b3d-b31d-b17e578affe2 service nova] Unable to find a host for instance e1603b23-7837-41b5-b502-af4dc9a66c94. Dropping event network-vif-unplugged {{(pid=116748) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 09 13:24:00.580917 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-70cbaf47-f2ec-4949-a9c4-89cd6733f4e8 req-815f9bdd-0283-4b3d-b31d-b17e578affe2 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.146137 Feb 09 13:24:00.580917 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 546/1073] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 147 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 09 13:24:01.252951 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ba1565a8-066b-4a97-b2a7-d4bceed546ed tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:01.253564 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-ba1565a8-066b-4a97-b2a7-d4bceed546ed tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:01.259877 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ba1565a8-066b-4a97-b2a7-d4bceed546ed tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:01.260324 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ba1565a8-066b-4a97-b2a7-d4bceed546ed tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:01.261113 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ba1565a8-066b-4a97-b2a7-d4bceed546ed tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:01.261542 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ba1565a8-066b-4a97-b2a7-d4bceed546ed tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:01.402101 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ba1565a8-066b-4a97-b2a7-d4bceed546ed tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:24:01.410811 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-ba1565a8-066b-4a97-b2a7-d4bceed546ed tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1519 microversion: 2.1 time: 0.161515 Feb 09 13:24:01.411384 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 528/1074] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:01 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:24:02.429149 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-e85fdcc7-25b4-4557-adca-9879bc8a6716 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:02.429677 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-e85fdcc7-25b4-4557-adca-9879bc8a6716 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:02.436852 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e85fdcc7-25b4-4557-adca-9879bc8a6716 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:02.437306 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e85fdcc7-25b4-4557-adca-9879bc8a6716 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:02.438106 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e85fdcc7-25b4-4557-adca-9879bc8a6716 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:02.438549 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-e85fdcc7-25b4-4557-adca-9879bc8a6716 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:02.577893 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-e85fdcc7-25b4-4557-adca-9879bc8a6716 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:24:02.585215 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-e85fdcc7-25b4-4557-adca-9879bc8a6716 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1519 microversion: 2.1 time: 0.159971 Feb 09 13:24:02.585778 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 547/1075] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:02 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:24:03.602656 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-a3056d8a-53c0-4af2-925f-9909874c279d tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:03.603274 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-a3056d8a-53c0-4af2-925f-9909874c279d tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:03.610029 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a3056d8a-53c0-4af2-925f-9909874c279d tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:03.610479 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a3056d8a-53c0-4af2-925f-9909874c279d tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:03.611301 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a3056d8a-53c0-4af2-925f-9909874c279d tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:03.611733 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a3056d8a-53c0-4af2-925f-9909874c279d tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:03.756323 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-a3056d8a-53c0-4af2-925f-9909874c279d tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:24:03.764020 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-a3056d8a-53c0-4af2-925f-9909874c279d tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1575 microversion: 2.1 time: 0.165176 Feb 09 13:24:03.764595 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 529/1076] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:03 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:24:03.991111 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-9420bc32-0735-4df4-a763-b7e83b26ade0 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:03.991634 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-9420bc32-0735-4df4-a763-b7e83b26ade0 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:03.992733 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-6d6e36ee-676f-4080-991f-3e21b2bff74e req-955a54fa-2c7b-465b-88b3-aa87e5133466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ce4c8e-d560-4c3b-8929-1f125064ac2d", "tag": "2a571256-0a84-4e0f-ad42-d0f61dbe95c1"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:24:03.994420 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:24:03.994420 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:24:03.998891 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9420bc32-0735-4df4-a763-b7e83b26ade0 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:03.999345 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9420bc32-0735-4df4-a763-b7e83b26ade0 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:04.000162 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9420bc32-0735-4df4-a763-b7e83b26ade0 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:04.000601 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-9420bc32-0735-4df4-a763-b7e83b26ade0 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:04.002396 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-6d6e36ee-676f-4080-991f-3e21b2bff74e req-955a54fa-2c7b-465b-88b3-aa87e5133466 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:04.002923 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-6d6e36ee-676f-4080-991f-3e21b2bff74e req-955a54fa-2c7b-465b-88b3-aa87e5133466 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:04.015719 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-6d6e36ee-676f-4080-991f-3e21b2bff74e req-955a54fa-2c7b-465b-88b3-aa87e5133466 service nova] Creating event network-changed:2a571256-0a84-4e0f-ad42-d0f61dbe95c1 for instance f1ce4c8e-d560-4c3b-8929-1f125064ac2d on hv-cinder-82786 Feb 09 13:24:04.021835 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-6d6e36ee-676f-4080-991f-3e21b2bff74e req-955a54fa-2c7b-465b-88b3-aa87e5133466 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032743 Feb 09 13:24:04.022649 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 530/1077] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:24:04.029170 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-9420bc32-0735-4df4-a763-b7e83b26ade0 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Going to try to terminate instance {{(pid=116748) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 09 13:24:04.357567 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-9420bc32-0735-4df4-a763-b7e83b26ade0 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "DELETE /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d" status: 204 len: 0 microversion: 2.1 time: 0.370284 Feb 09 13:24:04.358367 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 548/1078] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:24:03 2022] DELETE /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 09 13:24:04.366967 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-61afecf7-69a3-43b3-a28e-4514de76c401 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:04.368286 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-61afecf7-69a3-43b3-a28e-4514de76c401 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:04.374769 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-61afecf7-69a3-43b3-a28e-4514de76c401 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:04.375174 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-61afecf7-69a3-43b3-a28e-4514de76c401 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:04.375982 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-61afecf7-69a3-43b3-a28e-4514de76c401 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:04.376498 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-61afecf7-69a3-43b3-a28e-4514de76c401 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:04.598084 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-61afecf7-69a3-43b3-a28e-4514de76c401 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:24:04.607216 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-61afecf7-69a3-43b3-a28e-4514de76c401 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d" status: 200 len: 1576 microversion: 2.1 time: 0.244509 Feb 09 13:24:04.616979 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 531/1079] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:04 2022] GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d => generated 1576 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:24:04.781975 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-65ab1fc2-b03f-4541-9218-d2f46b6bc0d8 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:04.782822 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-65ab1fc2-b03f-4541-9218-d2f46b6bc0d8 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:04.788902 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-65ab1fc2-b03f-4541-9218-d2f46b6bc0d8 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:04.789448 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-65ab1fc2-b03f-4541-9218-d2f46b6bc0d8 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:04.790251 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-65ab1fc2-b03f-4541-9218-d2f46b6bc0d8 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:04.790718 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-65ab1fc2-b03f-4541-9218-d2f46b6bc0d8 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:04.934492 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-65ab1fc2-b03f-4541-9218-d2f46b6bc0d8 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:24:04.942111 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-65ab1fc2-b03f-4541-9218-d2f46b6bc0d8 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1575 microversion: 2.1 time: 0.164794 Feb 09 13:24:04.942787 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 549/1080] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:04 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:24:05.624445 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-a5c09022-32fc-4e17-bb61-50d306bd9ac4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:05.625054 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-a5c09022-32fc-4e17-bb61-50d306bd9ac4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:05.631362 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a5c09022-32fc-4e17-bb61-50d306bd9ac4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:05.631808 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a5c09022-32fc-4e17-bb61-50d306bd9ac4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:05.632587 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a5c09022-32fc-4e17-bb61-50d306bd9ac4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:05.633028 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-a5c09022-32fc-4e17-bb61-50d306bd9ac4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:05.778191 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-a5c09022-32fc-4e17-bb61-50d306bd9ac4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:24:05.785751 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-a5c09022-32fc-4e17-bb61-50d306bd9ac4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d" status: 200 len: 1458 microversion: 2.1 time: 0.165042 Feb 09 13:24:05.786310 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 532/1081] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:05 2022] GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d => generated 1458 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:24:05.959663 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-f213a43c-4530-4f1c-a703-3ae75211ddb7 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:05.960329 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-f213a43c-4530-4f1c-a703-3ae75211ddb7 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:05.967256 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f213a43c-4530-4f1c-a703-3ae75211ddb7 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:05.967710 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f213a43c-4530-4f1c-a703-3ae75211ddb7 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:05.968495 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f213a43c-4530-4f1c-a703-3ae75211ddb7 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:05.968962 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-f213a43c-4530-4f1c-a703-3ae75211ddb7 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:06.103095 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-f213a43c-4530-4f1c-a703-3ae75211ddb7 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:24:06.111091 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-f213a43c-4530-4f1c-a703-3ae75211ddb7 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1575 microversion: 2.1 time: 0.154976 Feb 09 13:24:06.111657 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 550/1082] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:05 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:24:06.803225 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-e111b254-3e9f-4caa-929a-3013cd43343a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:06.803834 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-e111b254-3e9f-4caa-929a-3013cd43343a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:06.817611 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e111b254-3e9f-4caa-929a-3013cd43343a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:06.818065 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e111b254-3e9f-4caa-929a-3013cd43343a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:06.818911 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e111b254-3e9f-4caa-929a-3013cd43343a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:06.819352 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-e111b254-3e9f-4caa-929a-3013cd43343a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:06.889251 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-e111b254-3e9f-4caa-929a-3013cd43343a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:24:06.896635 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-e111b254-3e9f-4caa-929a-3013cd43343a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d" status: 200 len: 1391 microversion: 2.1 time: 0.097066 Feb 09 13:24:06.897204 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 533/1083] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:06 2022] GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d => generated 1391 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:24:06.977779 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-d143c8cb-a610-4ee3-8935-4d3272506f47 req-612e8be0-9bbd-4f4f-a31b-7cd0948202f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ce4c8e-d560-4c3b-8929-1f125064ac2d", "name": "network-vif-deleted", "tag": "2a571256-0a84-4e0f-ad42-d0f61dbe95c1"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:24:06.979317 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:24:06.979317 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:24:06.987023 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-d143c8cb-a610-4ee3-8935-4d3272506f47 req-612e8be0-9bbd-4f4f-a31b-7cd0948202f5 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:06.987567 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-d143c8cb-a610-4ee3-8935-4d3272506f47 req-612e8be0-9bbd-4f4f-a31b-7cd0948202f5 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:06.999007 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-d143c8cb-a610-4ee3-8935-4d3272506f47 req-612e8be0-9bbd-4f4f-a31b-7cd0948202f5 service nova] Creating event network-vif-deleted:2a571256-0a84-4e0f-ad42-d0f61dbe95c1 for instance f1ce4c8e-d560-4c3b-8929-1f125064ac2d on hv-cinder-82786 Feb 09 13:24:07.004192 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-d143c8cb-a610-4ee3-8935-4d3272506f47 req-612e8be0-9bbd-4f4f-a31b-7cd0948202f5 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030269 Feb 09 13:24:07.004767 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 551/1084] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:24:07.128022 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8e44d649-09ca-4e51-a34d-5493fdbdbcc3 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:07.128638 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8e44d649-09ca-4e51-a34d-5493fdbdbcc3 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:07.134454 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8e44d649-09ca-4e51-a34d-5493fdbdbcc3 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:07.135052 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8e44d649-09ca-4e51-a34d-5493fdbdbcc3 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:07.135865 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8e44d649-09ca-4e51-a34d-5493fdbdbcc3 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:07.136309 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8e44d649-09ca-4e51-a34d-5493fdbdbcc3 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:07.273358 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-8e44d649-09ca-4e51-a34d-5493fdbdbcc3 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:24:07.281779 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8e44d649-09ca-4e51-a34d-5493fdbdbcc3 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1575 microversion: 2.1 time: 0.157528 Feb 09 13:24:07.282356 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 534/1085] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:07 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:24:07.916222 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-84936039-555d-461b-98fb-494b9a67f6cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:07.918817 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-84936039-555d-461b-98fb-494b9a67f6cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:07.926423 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-84936039-555d-461b-98fb-494b9a67f6cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:07.926908 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-84936039-555d-461b-98fb-494b9a67f6cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:07.927733 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-84936039-555d-461b-98fb-494b9a67f6cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:07.928175 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-84936039-555d-461b-98fb-494b9a67f6cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:07.962242 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-84936039-555d-461b-98fb-494b9a67f6cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:07.962815 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-84936039-555d-461b-98fb-494b9a67f6cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:07.963271 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-84936039-555d-461b-98fb-494b9a67f6cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lazy-loading 'fault' on Instance uuid f1ce4c8e-d560-4c3b-8929-1f125064ac2d {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:24:08.004282 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-84936039-555d-461b-98fb-494b9a67f6cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:24:08.012030 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-84936039-555d-461b-98fb-494b9a67f6cf tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d" status: 200 len: 1230 microversion: 2.1 time: 0.100259 Feb 09 13:24:08.016278 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 552/1086] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:07 2022] GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:24:08.298878 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-406ab30b-b70b-4b48-8990-d7e2c6b291cf tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:08.299516 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-406ab30b-b70b-4b48-8990-d7e2c6b291cf tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:08.306225 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-406ab30b-b70b-4b48-8990-d7e2c6b291cf tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:08.306758 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-406ab30b-b70b-4b48-8990-d7e2c6b291cf tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:08.307559 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-406ab30b-b70b-4b48-8990-d7e2c6b291cf tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:08.308001 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-406ab30b-b70b-4b48-8990-d7e2c6b291cf tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:08.445855 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-406ab30b-b70b-4b48-8990-d7e2c6b291cf tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:24:08.453809 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-406ab30b-b70b-4b48-8990-d7e2c6b291cf tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1575 microversion: 2.1 time: 0.158666 Feb 09 13:24:08.454379 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 535/1087] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:08 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:24:09.029390 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-fed3083c-cb7a-4bf9-a0d6-d554cc892f65 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:09.030041 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-fed3083c-cb7a-4bf9-a0d6-d554cc892f65 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: f1ce4c8e-d560-4c3b-8929-1f125064ac2d] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:09.036768 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fed3083c-cb7a-4bf9-a0d6-d554cc892f65 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:09.037223 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fed3083c-cb7a-4bf9-a0d6-d554cc892f65 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:09.038015 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fed3083c-cb7a-4bf9-a0d6-d554cc892f65 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:09.038459 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fed3083c-cb7a-4bf9-a0d6-d554cc892f65 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:09.052279 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.wsgi [None req-fed3083c-cb7a-4bf9-a0d6-d554cc892f65 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] HTTP exception thrown: Instance f1ce4c8e-d560-4c3b-8929-1f125064ac2d could not be found. Feb 09 13:24:09.054000 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-fed3083c-cb7a-4bf9-a0d6-d554cc892f65 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Returning 404 to user: Instance f1ce4c8e-d560-4c3b-8929-1f125064ac2d could not be found. {{(pid=116748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:24:09.054000 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-fed3083c-cb7a-4bf9-a0d6-d554cc892f65 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d" status: 404 len: 111 microversion: 2.1 time: 0.028193 Feb 09 13:24:09.054255 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 553/1088] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:09 2022] GET /compute/v2.1/servers/f1ce4c8e-d560-4c3b-8929-1f125064ac2d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:24:09.471089 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c1494f07-dbbc-4d7a-83fa-2deacb3efabc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:09.471752 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-c1494f07-dbbc-4d7a-83fa-2deacb3efabc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:09.478082 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c1494f07-dbbc-4d7a-83fa-2deacb3efabc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:09.485496 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c1494f07-dbbc-4d7a-83fa-2deacb3efabc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:09.485496 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c1494f07-dbbc-4d7a-83fa-2deacb3efabc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:09.485496 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c1494f07-dbbc-4d7a-83fa-2deacb3efabc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:09.614958 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-c1494f07-dbbc-4d7a-83fa-2deacb3efabc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:24:09.622765 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c1494f07-dbbc-4d7a-83fa-2deacb3efabc tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1575 microversion: 2.1 time: 0.155315 Feb 09 13:24:09.623339 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 536/1089] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:09 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:24:10.639332 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-06227fd7-28d7-4cd9-a150-dcf53e6abdb0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:10.639957 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-06227fd7-28d7-4cd9-a150-dcf53e6abdb0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:10.646310 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-06227fd7-28d7-4cd9-a150-dcf53e6abdb0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:10.646803 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-06227fd7-28d7-4cd9-a150-dcf53e6abdb0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:10.647620 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-06227fd7-28d7-4cd9-a150-dcf53e6abdb0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:10.648062 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-06227fd7-28d7-4cd9-a150-dcf53e6abdb0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:10.784943 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-06227fd7-28d7-4cd9-a150-dcf53e6abdb0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:24:10.793566 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-06227fd7-28d7-4cd9-a150-dcf53e6abdb0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1575 microversion: 2.1 time: 0.157316 Feb 09 13:24:10.794151 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 554/1090] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:10 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:24:11.811309 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-63811f2e-0eb9-4ac8-b108-b25311dd9bb9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:11.811918 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-63811f2e-0eb9-4ac8-b108-b25311dd9bb9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:11.818042 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-63811f2e-0eb9-4ac8-b108-b25311dd9bb9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:11.818486 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-63811f2e-0eb9-4ac8-b108-b25311dd9bb9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:11.819298 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-63811f2e-0eb9-4ac8-b108-b25311dd9bb9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:11.819800 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-63811f2e-0eb9-4ac8-b108-b25311dd9bb9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:12.006298 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-63811f2e-0eb9-4ac8-b108-b25311dd9bb9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:24:12.014064 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-63811f2e-0eb9-4ac8-b108-b25311dd9bb9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1575 microversion: 2.1 time: 0.206895 Feb 09 13:24:12.014827 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 537/1091] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:11 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1575 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:24:12.420231 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-706713ae-3692-4552-9459-1ea28b62aa6b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:12.420837 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-706713ae-3692-4552-9459-1ea28b62aa6b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:12.425720 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-87459218-1852-4f71-b2ed-e4faf4d79a67 req-53ab5935-9bd7-49b1-84ed-76a47b2bc74c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f2ac1f9-be36-466a-ac50-831c548547c7", "tag": "d0473794-25d6-4297-bd7b-f2930167cb57"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:24:12.427519 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:24:12.427519 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:24:12.428715 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-706713ae-3692-4552-9459-1ea28b62aa6b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:12.429359 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-706713ae-3692-4552-9459-1ea28b62aa6b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:12.430167 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-706713ae-3692-4552-9459-1ea28b62aa6b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:12.430631 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-706713ae-3692-4552-9459-1ea28b62aa6b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:12.436013 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-87459218-1852-4f71-b2ed-e4faf4d79a67 req-53ab5935-9bd7-49b1-84ed-76a47b2bc74c service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:12.436453 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-87459218-1852-4f71-b2ed-e4faf4d79a67 req-53ab5935-9bd7-49b1-84ed-76a47b2bc74c service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:12.447694 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-87459218-1852-4f71-b2ed-e4faf4d79a67 req-53ab5935-9bd7-49b1-84ed-76a47b2bc74c service nova] Creating event network-changed:d0473794-25d6-4297-bd7b-f2930167cb57 for instance 3f2ac1f9-be36-466a-ac50-831c548547c7 on hv-cinder-82786 Feb 09 13:24:12.453160 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-87459218-1852-4f71-b2ed-e4faf4d79a67 req-53ab5935-9bd7-49b1-84ed-76a47b2bc74c service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031077 Feb 09 13:24:12.453945 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 538/1092] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 09 13:24:12.457717 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-706713ae-3692-4552-9459-1ea28b62aa6b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Going to try to terminate instance {{(pid=116748) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 09 13:24:12.792453 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-84caf3ba-dbc4-45b4-af3b-c6df9cd8fdef req-dfbf570b-c3f6-4a64-879a-7d279a75be61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1603b23-7837-41b5-b502-af4dc9a66c94", "name": "network-vif-plugged", "status": "completed", "tag": "1c03d285-4ab1-4f1e-af2c-efca29aa27c4"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:24:12.793929 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:24:12.793929 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:24:12.801222 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-84caf3ba-dbc4-45b4-af3b-c6df9cd8fdef req-dfbf570b-c3f6-4a64-879a-7d279a75be61 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:12.802916 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-84caf3ba-dbc4-45b4-af3b-c6df9cd8fdef req-dfbf570b-c3f6-4a64-879a-7d279a75be61 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:12.813395 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-84caf3ba-dbc4-45b4-af3b-c6df9cd8fdef req-dfbf570b-c3f6-4a64-879a-7d279a75be61 service nova] Creating event network-vif-plugged:1c03d285-4ab1-4f1e-af2c-efca29aa27c4 for instance e1603b23-7837-41b5-b502-af4dc9a66c94 on hv-cinder-82786 Feb 09 13:24:12.818483 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-84caf3ba-dbc4-45b4-af3b-c6df9cd8fdef req-dfbf570b-c3f6-4a64-879a-7d279a75be61 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030374 Feb 09 13:24:12.819109 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 539/1093] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:24:12.824650 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-706713ae-3692-4552-9459-1ea28b62aa6b tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "DELETE /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 204 len: 0 microversion: 2.1 time: 0.407532 Feb 09 13:24:12.825321 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 555/1094] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:24:12 2022] DELETE /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 09 13:24:12.834375 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-dd5f2b7e-b325-40dc-9565-f9fd424aa42a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:12.835128 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-dd5f2b7e-b325-40dc-9565-f9fd424aa42a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:12.842935 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-dd5f2b7e-b325-40dc-9565-f9fd424aa42a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:12.843547 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-dd5f2b7e-b325-40dc-9565-f9fd424aa42a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:12.844878 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-dd5f2b7e-b325-40dc-9565-f9fd424aa42a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:12.845330 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-dd5f2b7e-b325-40dc-9565-f9fd424aa42a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:13.033712 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-1596d53f-8df2-49a9-8a28-efc50da737e4 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:13.035569 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-1596d53f-8df2-49a9-8a28-efc50da737e4 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:13.061089 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1596d53f-8df2-49a9-8a28-efc50da737e4 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:13.061686 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1596d53f-8df2-49a9-8a28-efc50da737e4 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:13.062716 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1596d53f-8df2-49a9-8a28-efc50da737e4 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:13.063265 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-1596d53f-8df2-49a9-8a28-efc50da737e4 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:13.089797 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-dd5f2b7e-b325-40dc-9565-f9fd424aa42a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:24:13.104017 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-dd5f2b7e-b325-40dc-9565-f9fd424aa42a tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1577 microversion: 2.1 time: 0.273390 Feb 09 13:24:13.105219 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 540/1095] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:12 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1577 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:24:13.247986 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-1596d53f-8df2-49a9-8a28-efc50da737e4 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:24:13.255573 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-1596d53f-8df2-49a9-8a28-efc50da737e4 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1575 microversion: 2.1 time: 0.227103 Feb 09 13:24:13.256150 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 556/1096] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:13 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1575 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:24:14.122422 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-ed6ba440-75ee-4b96-b56b-37b37379c5f4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:14.123059 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-ed6ba440-75ee-4b96-b56b-37b37379c5f4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:14.129638 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ed6ba440-75ee-4b96-b56b-37b37379c5f4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:14.130116 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ed6ba440-75ee-4b96-b56b-37b37379c5f4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:14.130993 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ed6ba440-75ee-4b96-b56b-37b37379c5f4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:14.131478 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-ed6ba440-75ee-4b96-b56b-37b37379c5f4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:14.268784 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-ed6ba440-75ee-4b96-b56b-37b37379c5f4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:24:14.272093 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-d1571d53-fcf4-4dfc-8bad-583c93abcfc9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:14.272708 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-d1571d53-fcf4-4dfc-8bad-583c93abcfc9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:14.276292 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-ed6ba440-75ee-4b96-b56b-37b37379c5f4 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1459 microversion: 2.1 time: 0.158232 Feb 09 13:24:14.276860 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 541/1097] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:14 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1459 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:24:14.279185 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d1571d53-fcf4-4dfc-8bad-583c93abcfc9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:14.279742 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d1571d53-fcf4-4dfc-8bad-583c93abcfc9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:14.280542 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d1571d53-fcf4-4dfc-8bad-583c93abcfc9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:14.280979 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-d1571d53-fcf4-4dfc-8bad-583c93abcfc9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:14.417293 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-d1571d53-fcf4-4dfc-8bad-583c93abcfc9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:24:14.425258 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-d1571d53-fcf4-4dfc-8bad-583c93abcfc9 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1575 microversion: 2.1 time: 0.156813 Feb 09 13:24:14.425973 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 557/1098] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:14 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 09 13:24:15.292766 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-6139efdb-5152-4697-ae8c-7567bc8def07 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:15.293382 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-6139efdb-5152-4697-ae8c-7567bc8def07 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:15.299619 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6139efdb-5152-4697-ae8c-7567bc8def07 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:15.301629 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6139efdb-5152-4697-ae8c-7567bc8def07 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:15.301629 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6139efdb-5152-4697-ae8c-7567bc8def07 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:15.301629 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-6139efdb-5152-4697-ae8c-7567bc8def07 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:15.394289 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-6139efdb-5152-4697-ae8c-7567bc8def07 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:24:15.405397 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-6139efdb-5152-4697-ae8c-7567bc8def07 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1392 microversion: 2.1 time: 0.116372 Feb 09 13:24:15.405981 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 542/1099] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:15 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1392 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:24:15.406122 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-9c043659-d587-41e6-be91-ef410e78fa54 req-94a71243-2109-44a3-b6f4-58a36ef4b34f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f2ac1f9-be36-466a-ac50-831c548547c7", "name": "network-vif-deleted", "tag": "d0473794-25d6-4297-bd7b-f2930167cb57"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:24:15.407951 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:24:15.407951 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:24:15.415806 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-9c043659-d587-41e6-be91-ef410e78fa54 req-94a71243-2109-44a3-b6f4-58a36ef4b34f service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:15.416337 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-9c043659-d587-41e6-be91-ef410e78fa54 req-94a71243-2109-44a3-b6f4-58a36ef4b34f service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:15.427773 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-9c043659-d587-41e6-be91-ef410e78fa54 req-94a71243-2109-44a3-b6f4-58a36ef4b34f service nova] Creating event network-vif-deleted:d0473794-25d6-4297-bd7b-f2930167cb57 for instance 3f2ac1f9-be36-466a-ac50-831c548547c7 on hv-cinder-82786 Feb 09 13:24:15.433096 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-9c043659-d587-41e6-be91-ef410e78fa54 req-94a71243-2109-44a3-b6f4-58a36ef4b34f service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030888 Feb 09 13:24:15.434311 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 558/1100] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:24:15.443451 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-02ede4d3-47aa-4c00-bc6b-c69716c9c7d0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:15.444059 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-02ede4d3-47aa-4c00-bc6b-c69716c9c7d0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:15.451457 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-02ede4d3-47aa-4c00-bc6b-c69716c9c7d0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:15.459180 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-02ede4d3-47aa-4c00-bc6b-c69716c9c7d0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:15.459180 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-02ede4d3-47aa-4c00-bc6b-c69716c9c7d0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:15.459180 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-02ede4d3-47aa-4c00-bc6b-c69716c9c7d0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:15.594529 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-02ede4d3-47aa-4c00-bc6b-c69716c9c7d0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:24:15.601921 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-02ede4d3-47aa-4c00-bc6b-c69716c9c7d0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1562 microversion: 2.1 time: 0.163342 Feb 09 13:24:15.602481 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 543/1101] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:15 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:24:16.427845 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-fcb6a9e9-bdca-4892-b1e9-a719f0522515 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:16.428643 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-fcb6a9e9-bdca-4892-b1e9-a719f0522515 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:16.436118 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fcb6a9e9-bdca-4892-b1e9-a719f0522515 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:16.436832 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fcb6a9e9-bdca-4892-b1e9-a719f0522515 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:16.442625 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fcb6a9e9-bdca-4892-b1e9-a719f0522515 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:16.442625 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fcb6a9e9-bdca-4892-b1e9-a719f0522515 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:16.472295 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fcb6a9e9-bdca-4892-b1e9-a719f0522515 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:16.472824 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-fcb6a9e9-bdca-4892-b1e9-a719f0522515 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:16.473283 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-fcb6a9e9-bdca-4892-b1e9-a719f0522515 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lazy-loading 'fault' on Instance uuid 3f2ac1f9-be36-466a-ac50-831c548547c7 {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:24:16.521494 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-fcb6a9e9-bdca-4892-b1e9-a719f0522515 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b331092b7645388e37636426326374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef8e70a161475ab7130108627df2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:24:16.530177 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-fcb6a9e9-bdca-4892-b1e9-a719f0522515 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 200 len: 1230 microversion: 2.1 time: 0.108303 Feb 09 13:24:16.530815 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 559/1102] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:16 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 1230 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:24:17.548412 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c2e51ab7-eec2-4649-93bf-8e9b099c67d3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:17.548961 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-c2e51ab7-eec2-4649-93bf-8e9b099c67d3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 3f2ac1f9-be36-466a-ac50-831c548547c7] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:17.555364 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c2e51ab7-eec2-4649-93bf-8e9b099c67d3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:17.555793 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c2e51ab7-eec2-4649-93bf-8e9b099c67d3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:17.556607 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c2e51ab7-eec2-4649-93bf-8e9b099c67d3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:17.557146 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-c2e51ab7-eec2-4649-93bf-8e9b099c67d3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:17.571056 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-c2e51ab7-eec2-4649-93bf-8e9b099c67d3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] HTTP exception thrown: Instance 3f2ac1f9-be36-466a-ac50-831c548547c7 could not be found. Feb 09 13:24:17.571056 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-c2e51ab7-eec2-4649-93bf-8e9b099c67d3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Returning 404 to user: Instance 3f2ac1f9-be36-466a-ac50-831c548547c7 could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:24:17.571755 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-c2e51ab7-eec2-4649-93bf-8e9b099c67d3 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7" status: 404 len: 111 microversion: 2.1 time: 0.027084 Feb 09 13:24:17.572187 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 544/1103] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:17 2022] GET /compute/v2.1/servers/3f2ac1f9-be36-466a-ac50-831c548547c7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 09 13:24:18.334092 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-bd4befc9-10e8-4436-aba0-f773671b65f1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:18.338431 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-bd4befc9-10e8-4436-aba0-f773671b65f1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:18.341074 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bd4befc9-10e8-4436-aba0-f773671b65f1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:18.341520 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bd4befc9-10e8-4436-aba0-f773671b65f1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:18.342339 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bd4befc9-10e8-4436-aba0-f773671b65f1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:18.342818 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-bd4befc9-10e8-4436-aba0-f773671b65f1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:18.358537 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.wsgi [None req-bd4befc9-10e8-4436-aba0-f773671b65f1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] HTTP exception thrown: Instance 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 could not be found. Feb 09 13:24:18.359164 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-bd4befc9-10e8-4436-aba0-f773671b65f1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Returning 404 to user: Instance 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 could not be found. {{(pid=116748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:24:18.359998 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-bd4befc9-10e8-4436-aba0-f773671b65f1 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "DELETE /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 404 len: 111 microversion: 2.1 time: 0.029696 Feb 09 13:24:18.360538 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 560/1104] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:24:18 2022] DELETE /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:24:18.369082 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d00f4852-2078-4638-a8ba-1bbb4d661844 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:18.369694 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-d00f4852-2078-4638-a8ba-1bbb4d661844 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] [instance: 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:24:18.377007 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d00f4852-2078-4638-a8ba-1bbb4d661844 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:18.377463 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d00f4852-2078-4638-a8ba-1bbb4d661844 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:18.378243 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d00f4852-2078-4638-a8ba-1bbb4d661844 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:24:18.378714 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-d00f4852-2078-4638-a8ba-1bbb4d661844 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:24:18.392259 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-d00f4852-2078-4638-a8ba-1bbb4d661844 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] HTTP exception thrown: Instance 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 could not be found. Feb 09 13:24:18.392875 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-d00f4852-2078-4638-a8ba-1bbb4d661844 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Returning 404 to user: Instance 794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:24:18.393735 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-d00f4852-2078-4638-a8ba-1bbb4d661844 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5" status: 404 len: 111 microversion: 2.1 time: 0.028630 Feb 09 13:24:18.394262 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 545/1105] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:24:18 2022] GET /compute/v2.1/servers/794b82e0-8aad-46b1-9e9e-9cfb0d16abf5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:24:19.869060 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-1a063c9f-d197-462b-ada7-c50d08da85c2 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] Calling method '.version_select at 0x7f7f64989e50>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:24:19.940093 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-1a063c9f-d197-462b-ada7-c50d08da85c2 tempest-TestVolumeBootPattern-1888871482 tempest-TestVolumeBootPattern-1888871482-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-423323945" status: 202 len: 0 microversion: 2.1 time: 0.074669 Feb 09 13:24:19.940716 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 561/1106] 10.222.0.84 () {58 vars in 1259 bytes} [Wed Feb 9 13:24:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-423323945 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:24:38.329319 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 09 13:24:38.329922 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: Wed Feb 9 13:24:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 09 13:25:36.017982 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [req-85549da9-a44c-40ac-b3c6-bc7aee3be2b4 req-6145478b-e3ef-4064-8a73-80e571bd8fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1603b23-7837-41b5-b502-af4dc9a66c94", "tag": "1c03d285-4ab1-4f1e-af2c-efca29aa27c4"}]} {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:25:36.019508 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:25:36.019508 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: warnings.warn(msg) Feb 09 13:25:36.025050 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-8e0b1807-0a79-400b-8fcd-912dde8d6071 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:25:36.025893 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8e0b1807-0a79-400b-8fcd-912dde8d6071 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:25:36.030100 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-85549da9-a44c-40ac-b3c6-bc7aee3be2b4 req-6145478b-e3ef-4064-8a73-80e571bd8fb4 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:25:36.030589 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [req-85549da9-a44c-40ac-b3c6-bc7aee3be2b4 req-6145478b-e3ef-4064-8a73-80e571bd8fb4 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:25:36.032134 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8e0b1807-0a79-400b-8fcd-912dde8d6071 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:25:36.032587 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8e0b1807-0a79-400b-8fcd-912dde8d6071 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:25:36.033376 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8e0b1807-0a79-400b-8fcd-912dde8d6071 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:25:36.033813 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-8e0b1807-0a79-400b-8fcd-912dde8d6071 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:25:36.043770 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.compute.server_external_events [req-85549da9-a44c-40ac-b3c6-bc7aee3be2b4 req-6145478b-e3ef-4064-8a73-80e571bd8fb4 service nova] Creating event network-changed:1c03d285-4ab1-4f1e-af2c-efca29aa27c4 for instance e1603b23-7837-41b5-b502-af4dc9a66c94 on hv-cinder-82786 Feb 09 13:25:36.050815 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [req-85549da9-a44c-40ac-b3c6-bc7aee3be2b4 req-6145478b-e3ef-4064-8a73-80e571bd8fb4 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037269 Feb 09 13:25:36.051753 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 562/1107] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:25:36.065732 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-8e0b1807-0a79-400b-8fcd-912dde8d6071 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Going to try to terminate instance {{(pid=116749) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 09 13:25:36.343166 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-8e0b1807-0a79-400b-8fcd-912dde8d6071 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "DELETE /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 204 len: 0 microversion: 2.1 time: 0.331618 Feb 09 13:25:36.344058 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 546/1108] 10.222.0.84 () {58 vars in 1238 bytes} [Wed Feb 9 13:25:36 2022] DELETE /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 09 13:25:36.353760 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-22d94540-ed20-467c-9077-80d65302a6e0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:25:36.354470 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-22d94540-ed20-467c-9077-80d65302a6e0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:25:36.360997 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-22d94540-ed20-467c-9077-80d65302a6e0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:25:36.361480 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-22d94540-ed20-467c-9077-80d65302a6e0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:25:36.362281 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-22d94540-ed20-467c-9077-80d65302a6e0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:25:36.362796 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-22d94540-ed20-467c-9077-80d65302a6e0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:25:36.505821 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-22d94540-ed20-467c-9077-80d65302a6e0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:25:36.514416 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-22d94540-ed20-467c-9077-80d65302a6e0 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1568 microversion: 2.1 time: 0.166068 Feb 09 13:25:36.515024 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 563/1109] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:25:36 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:25:37.532321 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-136ebc4e-55b0-46f0-8deb-3551fb549ee6 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:25:37.533027 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-136ebc4e-55b0-46f0-8deb-3551fb549ee6 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:25:37.539691 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-136ebc4e-55b0-46f0-8deb-3551fb549ee6 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:25:37.544033 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-136ebc4e-55b0-46f0-8deb-3551fb549ee6 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:25:37.544033 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-136ebc4e-55b0-46f0-8deb-3551fb549ee6 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:25:37.544033 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-136ebc4e-55b0-46f0-8deb-3551fb549ee6 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:25:37.687781 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.policy [None req-136ebc4e-55b0-46f0-8deb-3551fb549ee6 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116749) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:25:37.695121 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-136ebc4e-55b0-46f0-8deb-3551fb549ee6 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1449 microversion: 2.1 time: 0.167011 Feb 09 13:25:37.695791 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 547/1110] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:25:37 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:25:38.712505 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-85c28df0-95c4-42cf-9907-570bf8f25158 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:25:38.713119 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-85c28df0-95c4-42cf-9907-570bf8f25158 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:25:38.720319 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-85c28df0-95c4-42cf-9907-570bf8f25158 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:25:38.725711 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-85c28df0-95c4-42cf-9907-570bf8f25158 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:25:38.725711 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-85c28df0-95c4-42cf-9907-570bf8f25158 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:25:38.725711 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-85c28df0-95c4-42cf-9907-570bf8f25158 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:25:38.865819 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [req-a6c76b79-79d9-4eef-8a79-aca36a88f7c0 req-82d7e958-5d83-44ad-9f37-5ff11fa949b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1603b23-7837-41b5-b502-af4dc9a66c94", "name": "network-vif-deleted", "tag": "1c03d285-4ab1-4f1e-af2c-efca29aa27c4"}]} {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 09 13:25:38.868256 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 13:25:38.868256 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: warnings.warn(msg) Feb 09 13:25:38.868780 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-85c28df0-95c4-42cf-9907-570bf8f25158 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:25:38.876151 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-a6c76b79-79d9-4eef-8a79-aca36a88f7c0 req-82d7e958-5d83-44ad-9f37-5ff11fa949b0 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:25:38.876657 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [req-a6c76b79-79d9-4eef-8a79-aca36a88f7c0 req-82d7e958-5d83-44ad-9f37-5ff11fa949b0 service nova] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:25:38.877079 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-85c28df0-95c4-42cf-9907-570bf8f25158 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1449 microversion: 2.1 time: 0.168354 Feb 09 13:25:38.877655 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 564/1111] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:25:38 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1449 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:25:38.887309 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.compute.server_external_events [req-a6c76b79-79d9-4eef-8a79-aca36a88f7c0 req-82d7e958-5d83-44ad-9f37-5ff11fa949b0 service nova] Creating event network-vif-deleted:1c03d285-4ab1-4f1e-af2c-efca29aa27c4 for instance e1603b23-7837-41b5-b502-af4dc9a66c94 on hv-cinder-82786 Feb 09 13:25:38.892826 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [req-a6c76b79-79d9-4eef-8a79-aca36a88f7c0 req-82d7e958-5d83-44ad-9f37-5ff11fa949b0 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030774 Feb 09 13:25:38.893469 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 548/1112] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Feb 9 13:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 09 13:25:39.895974 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-934783aa-624a-4a61-a717-0b75f68bde9b tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:25:39.896619 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.compute.api [None req-934783aa-624a-4a61-a717-0b75f68bde9b tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116748) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:25:39.902852 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-934783aa-624a-4a61-a717-0b75f68bde9b tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:25:39.903819 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-934783aa-624a-4a61-a717-0b75f68bde9b tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:25:39.904608 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-934783aa-624a-4a61-a717-0b75f68bde9b tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:25:39.905049 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-934783aa-624a-4a61-a717-0b75f68bde9b tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:25:39.937017 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-934783aa-624a-4a61-a717-0b75f68bde9b tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:25:39.937478 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG oslo_concurrency.lockutils [None req-934783aa-624a-4a61-a717-0b75f68bde9b tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:25:39.937937 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.objects.instance [None req-934783aa-624a-4a61-a717-0b75f68bde9b tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lazy-loading 'fault' on Instance uuid e1603b23-7837-41b5-b502-af4dc9a66c94 {{(pid=116748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 09 13:25:39.977587 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.policy [None req-934783aa-624a-4a61-a717-0b75f68bde9b tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cf88d385f840d4808997bcc4aa24b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a995617c26584027b41b908107d1482b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116748) authorize /opt/stack/nova/nova/policy.py:199}} Feb 09 13:25:39.985644 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-934783aa-624a-4a61-a717-0b75f68bde9b tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 200 len: 1225 microversion: 2.1 time: 0.093416 Feb 09 13:25:39.986210 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 565/1113] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:25:39 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 09 13:25:41.003940 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-58d287f7-d3ff-44f3-9a28-9eae9fcfe029 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '>' {{(pid=116749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:25:41.004664 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.compute.api [None req-58d287f7-d3ff-44f3-9a28-9eae9fcfe029 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] [instance: e1603b23-7837-41b5-b502-af4dc9a66c94] Fetching instance by UUID {{(pid=116749) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 09 13:25:41.010782 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-58d287f7-d3ff-44f3-9a28-9eae9fcfe029 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:25:41.011242 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-58d287f7-d3ff-44f3-9a28-9eae9fcfe029 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:25:41.012039 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-58d287f7-d3ff-44f3-9a28-9eae9fcfe029 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 09 13:25:41.012479 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG oslo_concurrency.lockutils [None req-58d287f7-d3ff-44f3-9a28-9eae9fcfe029 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Lock "9e47d22a-5d94-47f3-baff-22c6e92e901b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 09 13:25:41.025131 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.wsgi [None req-58d287f7-d3ff-44f3-9a28-9eae9fcfe029 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] HTTP exception thrown: Instance e1603b23-7837-41b5-b502-af4dc9a66c94 could not be found. Feb 09 13:25:41.025722 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: DEBUG nova.api.openstack.wsgi [None req-58d287f7-d3ff-44f3-9a28-9eae9fcfe029 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Returning 404 to user: Instance e1603b23-7837-41b5-b502-af4dc9a66c94 could not be found. {{(pid=116749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 09 13:25:41.026540 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO nova.api.openstack.requestlog [None req-58d287f7-d3ff-44f3-9a28-9eae9fcfe029 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94" status: 404 len: 111 microversion: 2.1 time: 0.027178 Feb 09 13:25:41.027097 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: [pid: 116749|app: 0|req: 549/1114] 10.222.0.84 () {58 vars in 1235 bytes} [Wed Feb 9 13:25:40 2022] GET /compute/v2.1/servers/e1603b23-7837-41b5-b502-af4dc9a66c94 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 09 13:25:41.257230 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: DEBUG nova.api.openstack.wsgi [None req-64a98366-405d-4c74-a3fd-9e24ba78a839 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] Calling method '.version_select at 0x7f7f64919e50>' {{(pid=116748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 09 13:25:41.337599 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO nova.api.openstack.requestlog [None req-64a98366-405d-4c74-a3fd-9e24ba78a839 tempest-TestShelveInstance-1575507668 tempest-TestShelveInstance-1575507668-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2100513966" status: 202 len: 0 microversion: 2.1 time: 0.084077 Feb 09 13:25:41.338188 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: [pid: 116748|app: 0|req: 566/1115] 10.222.0.84 () {58 vars in 1253 bytes} [Wed Feb 9 13:25:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2100513966 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 09 13:26:24.626207 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 09 13:26:24.626835 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: Wed Feb 9 13:26:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 09 13:27:58.336982 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 09 13:27:58.337677 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: Wed Feb 9 13:27:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 09 13:27:58.790330 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 09 13:27:58.790935 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: Wed Feb 9 13:27:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 09 13:28:23.787431 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 09 13:28:23.788077 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: Wed Feb 9 13:28:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 09 13:29:36.077668 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 09 13:29:36.078260 dv-cinder-827860-3-iscsi devstack@n-api.service[116748]: Wed Feb 9 13:29:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 09 13:29:44.634236 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 09 13:29:44.634868 dv-cinder-827860-3-iscsi devstack@n-api.service[116749]: Wed Feb 9 13:29:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!